00000001:02000400:2.0F:1789607167.769175:0:3125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789607186.910587:0:3346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789607188.553525:0:3405:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 819 MB/s 00000001:01000000:3.0:1789607188.804402:0:3405:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1306 MB/s 00000001:01000000:2.0:1789607189.054560:0:3405:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7967 MB/s 00000020:02000000:0.0F:1789607189.999880:0:3437:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g2c5a7bf 00000400:02000000:0.0:1789607191.011222:0:3452:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.125@tcp [8/256/0/180] 00008000:02000000:3.0:1789607194.940491:0:3602:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789607264.707176:0:5862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789607273.501675:0:6450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789607273.501681:0:6450:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789607273.501806:0:6450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ecd758f2 00000080:02000400:3.0:1789607273.501815:0:6450:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789607273.511578:0:6450:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789607273.511590:0:6450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789607273.511628:0:6450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a471a6d8) 00000020:00000080:3.0:1789607273.511648:0:6450:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789607273.549212:0:6450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607273.549775:0:6450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607273.588042:0:6450:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789607273.588082:0:6450:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789607273.588103:0:6450:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789607273.588156:0:6450:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789607273.588184:0:6450:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789607273.588695:0:6450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789607273.588703:0:6450:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789607273.588714:0:6450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd0f4 00000020:01000004:2.0:1789607273.588722:0:6450:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789607273.588727:0:6450:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789607273.588732:0:6450:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ecd758f2 from MGS 00000020:01000004:2.0:1789607273.588736:0:6450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789607273.588756:0:6450:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000055b63820) 00000020:00000080:2.0:1789607273.588768:0:6450:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789607273.588843:0:6450:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ecd758f2 from MGS, refs=2 00080000:01000000:2.0:1789607273.588848:0:6450:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607273.588853:0:6450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd102 00000100:00100000:2.0:1789607273.589162:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789607273.589391:0:6450:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789607273.589407:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789607273.590135:0:6450:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789607273.590143:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789607273.591194:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607273.591455:0:6450:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789607273.591460:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789607273.592609:0:6450:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789607273.592619:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789607273.593035:0:6450:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789607273.593042:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1789607273.594025:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607273.594035:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607273.594037:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607273.594396:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607273.594399:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607273.594401:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607273.595426:0:6450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789607273.597989:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789607273.845646:0:6450:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2503 MB/s 00000001:01000000:1.0:1789607274.094925:0:6450:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6991 MB/s 00000001:01000000:0.0:1789607274.345308:0:6450:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 927 MB/s 00000001:01000000:0.0:1789607274.597289:0:6450:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 904 MB/s 00080000:10000000:0.0:1789607274.623186:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789607274.658050:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789607274.671960:0:6450:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789607274.671978:0:6450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789607274.671980:0:6450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789607274.681994:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789607274.682052:0:6450:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789607274.682112:0:6450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789607274.682351:0:6450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789607274.682381:0:6450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789607274.682718:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607274.682921:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789607274.682928:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789607274.683242:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789607274.683248:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789607274.683379:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789607274.683384:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789607274.683683:0:6450:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789607274.683702:0:6450:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.125@tcp' 00000020:01000004:0.0:1789607274.683704:0:6450:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789607274.683750:0:6450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.125@tcp (typ=mgc) 00000020:00000080:0.0:1789607274.683769:0:6450:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.125@tcp (000000000d56f319) 00000020:00000080:0.0:1789607274.683785:0:6450:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789607274.683943:0:6450:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b62fd447@MGC192.168.203.125@tcp: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607274.684125:0:6450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.125@tcp-0 is initialized 00000040:01000000:0.0:1789607274.684133:0:6450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789607274.684444:0:6465:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789607274.685041:0:6466:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789607274.685068:0:6450:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.125@tcp (uuid c0415db0-4674-4bfe-9696-a490439e72d4) 00000020:00000080:2.0:1789607274.685085:0:6450:0:(genops.c:1384:class_connect()) connect: client c0415db0-4674-4bfe-9696-a490439e72d4, cookie 0xa26202d240fbd110 00000100:00080000:2.0:1789607274.685094:0:6450:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607274.685100:0:6450:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import 00000000b62fd447 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607274.685138:0:6450:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007fbb8194 x1876539149910144/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607274.685152:0:6450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c0415db0-4674-4bfe-9696-a490439e72d4->MGS 00000020:01000004:2.0:1789607274.685166:0:6450:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789607274.685169:0:6450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789607274.685177:0:6450:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c19acb97) 00000020:00000080:2.0:1789607274.685185:0:6450:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789607274.688142:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fbb8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539149910144:0@lo:250: 00000100:00100000:3.0:1789607274.688253:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607274.688328:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910144 00000100:00100000:3.0:1789607274.688336:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910144 00000100:00100000:3.0:1789607274.688485:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607274.688492:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077585091 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3467:x1876539149910144:12345-0@lo:250: 00010000:00080000:3.0:1789607274.689409:0:6462:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c0415db0-4674-4bfe-9696-a490439e72d4@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1789607274.689457:0:6462:0:(genops.c:1384:class_connect()) connect: client c0415db0-4674-4bfe-9696-a490439e72d4, cookie 0xa26202d240fbd11e 00000100:00080000:3.0:1789607274.689604:0:6462:0:(import.c:65:import_set_state_nolock()) 00000000f27ff7ab : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607274.691957:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077585091 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+5:3467:x1876539149910144:12345-0@lo:250: Request processed in 1191us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607274.691975:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607274.692072:0:3467:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789607274.692083:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.125@tcp: connect to target with instance 0 00000100:00080000:3.0:1789607274.692100:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789607274.692105:0:3467:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789607274.692109:0:3467:0:(import.c:65:import_set_state_nolock()) 00000000b62fd447 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789607274.692112:0:3467:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789607274.692125:0:3467:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789607274.692131:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fbb8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539149910144:0@lo:250: 00000100:00100000:3.0:1789607274.696434:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607274.697117:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789607274.697125:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789607274.710657:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789607274.710671:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789607274.715673:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789607274.715743:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789607274.717373:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607274.717574:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789607274.717580:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789607274.718380:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789607274.718389:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789607274.785298:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607274.785523:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789607274.785530:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789607274.787281:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789607274.787295:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789607274.788010:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607274.788177:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789607274.788182:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789607274.788744:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789607274.788751:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789607274.789398:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607274.789549:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789607274.789553:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789607274.791732:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789607274.791742:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789607274.793740:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607274.794013:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789607274.794016:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789607274.794418:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789607274.794424:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789607274.815422:0:6450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607274.815772:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607274.815779:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789607274.817171:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789607274.817184:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789607274.819173:0:6450:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789607274.819187:0:6450:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789607274.820932:0:6450:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789607274.820956:0:6450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789607274.820962:0:6450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789607274.821088:0:6450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789607274.821123:0:6450:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789607274.821128:0:6450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789607274.821134:0:6450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607274.821135:0:6450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607274.821136:0:6450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607274.821137:0:6450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607274.821139:0:6450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607274.821140:0:6450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607274.821141:0:6450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607274.821142:0:6450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789607274.821143:0:6450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789607274.821145:0:6450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607274.821146:0:6450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607274.821148:0:6450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789607274.821150:0:6450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607274.821151:0:6450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607274.821152:0:6450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607274.821153:0:6450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607274.821154:0:6450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607274.821155:0:6450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607274.821156:0:6450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607274.821157:0:6450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607274.821158:0:6450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789607274.821158:0:6450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789607274.821159:0:6450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607274.821160:0:6450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607274.821186:0:6450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789607274.821206:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d926f0ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910272:0@lo:253: 00000100:00100000:2.0:1789607274.821300:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607274.821487:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910272 00000100:00100000:0.0:1789607274.821494:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910272 00000100:00100000:0.0:1789607274.821537:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607274.821545:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000004d1801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+5:6450:x1876539149910272:12345-0@lo:253: 20000000:01000000:0.0:1789607274.821585:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789607274.821588:0:6464:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1789607274.821996:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cf19681 going to sleep for 11 seconds 10000000:01000000:0.0:1789607274.822100:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789607274.822151:0:6464:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789607274.822467:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607274.823714:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789607274.824219:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789607274.824223:0:6464:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789607274.824228:0:6464:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789607274.824231:0:6464:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789607274.824246:0:6464:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789607274.824452:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607274.824775:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789607274.824789:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789607274.825149:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789607274.825217:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789607274.825257:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789607274.825352:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789607274.825361:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789607274.825416:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789607274.825425:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789607274.825456:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789607274.825464:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789607274.825494:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789607274.825556:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789607274.825588:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789607274.825594:0:6464:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789607274.825608:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607274.826118:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789607274.826130:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789607274.826167:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789607274.826203:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789607274.826253:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789607274.826265:0:6464:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789607274.826341:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789607274.826350:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789607274.826397:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789607274.826448:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789607274.826486:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789607274.826497:0:6464:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789607274.826606:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789607274.826617:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789607274.826788:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789607274.827154:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789607274.827338:0:6464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789607274.827385:0:6464:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789607274.827394:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789607274.828158:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789607274.828447:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789607274.828471:0:6464:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.125@tcp for mdt 20000000:01000000:0.0:1789607274.828473:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:0.0:1789607274.828533:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789607274.828543:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789607274.828588:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789607274.828596:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:0.0:1789607274.828789:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789607274.828801:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789607274.828837:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789607274.829094:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789607274.829167:0:6464:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789607274.829170:0:6464:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789607274.829173:0:6464:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789607274.829185:0:6464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789607274.829187:0:6464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789607274.829217:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789607274.829220:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789607274.829570:0:6487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789607274.830033:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789607274.830074:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789607274.830110:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1789607274.830121:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789607274.830123:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789607274.830529:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789607274.830846:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789607274.831037:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789607274.831097:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1789607274.831110:0:6464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607274.831112:0:6464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789607274.831116:0:6464:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789607274.831119:0:6464:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789607274.831124:0:6464:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789607274.831130:0:6464:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789607274.831448:0:6489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789607274.831562:0:6464:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789607274.848999:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789607274.849051:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789607274.849122:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789607274.849149:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789607274.849172:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849187:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849196:0:6464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849203:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849208:0:6464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849215:0:6464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849798:0:6464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cb928066 already unused, calling callback (0000000051141bff) 00010000:00010000:0.0:1789607274.849802:0:6464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849810:0:6464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849820:0:6464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849827:0:6464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607274.849832:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb928066/0xa26202d240fbd125 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607274.849851:0:6464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789607275.200494:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000004d1801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+5:6450:x1876539149910272:12345-0@lo:253: Request processed in 378934us (379179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.200524:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607275.202638:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d926f0ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910272:0@lo:253: 10000000:01000000:2.0:1789607275.202729:0:6450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789607275.202732:0:6450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607275.202734:0:6450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607275.202735:0:6450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607275.202737:0:6450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789607275.202738:0:6450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607275.202739:0:6450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607275.202755:0:6450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607275.202756:0:6450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607275.202758:0:6450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789607275.202760:0:6450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607275.202761:0:6450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789607275.202784:0:6450:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ecd758f2 from lustre-MDT0000 10000000:01000000:2.0:1789607275.202813:0:6450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789607275.202816:0:6450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789607275.202820:0:6450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d78e9ee99c0 10000000:01000000:2.0:1789607275.202824:0:6450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607275.202833:0:6450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78e9ee99c0 from 1 10000000:01000000:2.0:1789607275.202835:0:6450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789607275.202888:0:6450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.202899:0:6450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.202908:0:6450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607275.202926:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d926f0ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910400:0@lo:101: 00000100:00100000:2.0:1789607275.202982:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607275.203100:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2f6c472 going to sleep for 11 seconds 00000100:00100000:3.0:1789607275.203214:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910400 00000100:00100000:3.0:1789607275.203221:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910400 00000100:00100000:3.0:1789607275.203310:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607275.203319:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e61b97e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+5:6450:x1876539149910400:12345-0@lo:101: 00010000:00010000:3.0:1789607275.203332:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607275.203357:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd12c expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.203380:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd12c expref: 6 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.203389:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd12c expref: 6 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.203397:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ad80e5a, rc 0) 00000100:00100000:2.0:1789607275.203596:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d926f0ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910400:0@lo:101: 00010000:00010000:2.0:1789607275.203608:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.203616:0:6450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607275.203672:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d926f0ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910528:0@lo:501: 00000100:00100000:2.0:1789607275.204006:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607275.206467:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2f6c472 going to sleep for 11 seconds 00000100:00100000:3.0:1789607275.211013:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e61b97e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+6:6450:x1876539149910400:12345-0@lo:101: Request processed in 7688us (8023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607275.211041:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607275.211158:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910528 00000100:00100000:2.0:1789607275.211167:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910528 00000100:00100000:1.0:1789607275.212722:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607275.212741:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a71a1c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+6:6450:x1876539149910528:12345-0@lo:501: 00000100:00100000:1.0:1789607275.213046:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a71a1c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+6:6450:x1876539149910528:12345-0@lo:501: Request processed in 314us (9039us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607275.213054:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607275.213193:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d926f0ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910528:0@lo:501: 10000000:01000000:0.0:1789607275.213231:0:6450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789607275.213255:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.213266:0:6450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607275.213275:0:6450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78c75d7000 10000000:01000000:0.0:1789607275.213280:0:6450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789607275.213284:0:6450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d78c75d7000 10000000:01000000:0.0:1789607275.213287:0:6450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789607275.213296:0:6450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d78c75d7000 from 1 10000000:01000000:0.0:1789607275.213299:0:6450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789607275.213353:0:6450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.213361:0:6450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.213369:0:6450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607275.213387:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f07fb84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910656:0@lo:101: 00000100:00100000:0.0:1789607275.213442:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607275.213498:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6d7664f going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.213898:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910656 00000100:00100000:1.0:1789607275.213905:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910656 00000100:00100000:1.0:1789607275.213957:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607275.213965:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018fe9b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+6:6450:x1876539149910656:12345-0@lo:101: 00010000:00010000:1.0:1789607275.213976:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607275.213988:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004be8ca59/0xa26202d240fbd141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd13a expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.214009:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004be8ca59/0xa26202d240fbd141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd13a expref: 7 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.214018:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004be8ca59/0xa26202d240fbd141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd13a expref: 7 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.214025:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004be8ca59, rc 0) 00000100:00100000:1.0:1789607275.214060:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018fe9b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+7:6450:x1876539149910656:12345-0@lo:101: Request processed in 97us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.214066:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607275.214242:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f07fb84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910656:0@lo:101: 00010000:00010000:0.0:1789607275.214255:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.214262:0:6450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607275.214275:0:6450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789607275.214290:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.214297:0:6450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000cb928066/0xa26202d240fbd13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607275.214303:0:6450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789607275.214307:0:6450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607275.214328:0:6450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d78c75d7000 10000000:01000000:0.0:1789607275.214332:0:6450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789607275.214335:0:6450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789607275.214338:0:6450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607275.214355:0:6450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.214362:0:6450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.214369:0:6450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607275.214382:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f07fb84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910784:0@lo:101: 00000100:00100000:0.0:1789607275.214408:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607275.214436:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6d7664f going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.214630:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910784 00000100:00100000:1.0:1789607275.214635:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910784 00000100:00100000:1.0:1789607275.214663:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607275.214674:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b88b80cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+7:6450:x1876539149910784:12345-0@lo:101: 00010000:00010000:1.0:1789607275.214682:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607275.214689:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd148 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.214703:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd148 expref: 8 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.214710:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd148 expref: 8 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.214715:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a49b9ca, rc 0) 00000100:00100000:1.0:1789607275.214752:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b88b80cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+8:6450:x1876539149910784:12345-0@lo:101: Request processed in 78us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.214758:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607275.214828:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f07fb84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910784:0@lo:101: 00010000:00010000:3.0:1789607275.214838:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.214845:0:6450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607275.214931:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910912:0@lo:501: 00000100:00100000:3.0:1789607275.214957:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.214972:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000733cd862 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.215022:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149910912 00000100:00100000:1.0:1789607275.215026:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149910912 00000100:00100000:1.0:1789607275.215042:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607275.215047:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061862239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+8:6450:x1876539149910912:12345-0@lo:501: 00000100:00100000:1.0:1789607275.215264:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061862239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+9:6450:x1876539149910912:12345-0@lo:501: Request processed in 216us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.215271:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607275.215438:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149910912:0@lo:501: 00000100:00100000:3.0:1789607275.215469:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911040:0@lo:503: 00000100:00100000:3.0:1789607275.215524:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.215544:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000733cd862 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.215651:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911040 00000100:00100000:1.0:1789607275.215655:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911040 00000100:00100000:1.0:1789607275.215674:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607275.215679:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000389442db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+9:6450:x1876539149911040:12345-0@lo:503: 00000100:00100000:1.0:1789607275.215829:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000389442db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+9:6450:x1876539149911040:12345-0@lo:503: Request processed in 150us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.215844:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607275.215988:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911040:0@lo:503: 00000100:00100000:0.0:1789607275.216443:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087fa0aee pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6491:1876539149911168:0@lo:502: 00000100:00100000:0.0:1789607275.216559:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607275.216591:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 00000000162fca8d going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.216944:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911168 00000100:00100000:1.0:1789607275.216950:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911168 00000100:00100000:1.0:1789607275.216984:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607275.216990:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a643c5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+9:6491:x1876539149911168:12345-0@lo:502: 00000100:00100000:1.0:1789607275.217168:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a643c5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+9:6491:x1876539149911168:12345-0@lo:502: Request processed in 177us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.217175:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607275.217602:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087fa0aee pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6491:1876539149911168:0@lo:502: 00000020:01000000:3.0:1789607275.217628:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607275.217638:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607275.217640:0:6491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789607275.217644:0:6491:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789607275.217647:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607275.217660:0:6491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000928775fe) 00000020:00000080:3.0:1789607275.217676:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789607275.217681:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789607275.217760:0:6491:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789607275.217771:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd15d 00000020:00000080:3.0:1789607275.218004:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789607275.218009:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607275.218012:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607275.218014:0:6491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789607275.218017:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607275.218020:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607275.218021:0:6491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789607275.218025:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607275.218031:0:6491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000303f567f) 00000020:00000080:3.0:1789607275.218040:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789607275.218044:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789607275.218045:0:6491:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789607275.218048:0:6491:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789607275.218053:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789607275.218089:0:6491:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ecd758f2 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789607275.218100:0:6491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000937127cd) 00000020:00000080:3.0:1789607275.218107:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789607275.218166:0:6491:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789607275.218171:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd172 00000020:00000080:3.0:1789607275.218285:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789607275.218291:0:6491:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789607275.218295:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa26202d240fbd179 00080000:01000000:3.0:1789607275.218300:0:6491:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789607275.218303:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd180 00080000:10000000:3.0:1789607275.219110:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789607275.219320:0:6491:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789607275.226413:0:6491:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789607275.346228:0:6491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789607275.346534:0:6491:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789607275.348827:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789607275.349122:0:6491:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789607275.371938:0:6491:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c5b31940) 00000020:00000080:1.0:1789607275.371964:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789607275.372072:0:6491:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789607275.372080:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd18e 00000020:00000080:3.0:1789607275.375079:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789607275.378720:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607275.419308:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607275.468396:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.510938:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.571666:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607275.614050:0:6491:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789607275.647417:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa26202d240fbd195 00000020:00000080:0.0:1789607275.652021:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789607275.652037:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607275.652044:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607275.652046:0:6491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789607275.652051:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607275.652055:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607275.652056:0:6491:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607275.652060:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607275.652061:0:6491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789607275.652063:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607275.652066:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607275.652079:0:6491:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789607275.652082:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607275.652087:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607275.652088:0:6491:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789607275.652094:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789607275.652156:0:6491:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789607275.652212:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001e6db5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6491:1876539149911296:0@lo:502: 00000100:00100000:0.0:1789607275.652287:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607275.652398:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055098cfd going to sleep for 11 seconds 00000100:00100000:3.0:1789607275.654902:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911296 00000100:00100000:3.0:1789607275.654917:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911296 00000100:00100000:3.0:1789607275.654979:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607275.654988:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001bf6cd19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+9:6491:x1876539149911296:12345-0@lo:502: 00000100:00100000:3.0:1789607275.655351:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001bf6cd19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+9:6491:x1876539149911296:12345-0@lo:502: Request processed in 365us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607275.655359:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607275.655536:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001e6db5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6491:1876539149911296:0@lo:502: 00000020:01000000:0.0:1789607275.655568:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607275.655574:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607275.655576:0:6491:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789607275.655580:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789607275.656200:0:6450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789607275.656218:0:6450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789607275.656237:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.656249:0:6450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607275.656257:0:6450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c75d7000 from 1 10000000:01000000:3.0:1789607275.656260:0:6450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607275.656296:0:6450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.656303:0:6450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.656311:0:6450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607275.656329:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911424:0@lo:101: 00000100:00100000:3.0:1789607275.656382:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.656423:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 000000000135ec66 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.656496:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911424 00000100:00100000:1.0:1789607275.656512:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911424 00000100:00100000:1.0:1789607275.656545:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607275.656553:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e9719a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+9:6450:x1876539149911424:12345-0@lo:101: 00010000:00010000:1.0:1789607275.656563:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607275.656575:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd19c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.656595:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd19c expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.656604:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd19c expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.656612:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efa1da03, rc 0) 00000100:00100000:1.0:1789607275.656901:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e9719a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+10:6450:x1876539149911424:12345-0@lo:101: Request processed in 348us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.656914:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607275.657231:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911424:0@lo:101: 00010000:00010000:2.0:1789607275.657246:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.657254:0:6450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607275.658026:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911552:0@lo:256: 00000100:00100000:2.0:1789607275.658079:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607275.658176:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c15eb301 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.659767:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911552 00000100:00100000:1.0:1789607275.659780:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911552 00000100:00100000:1.0:1789607275.659899:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607275.659908:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003121fc73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+10:6450:x1876539149911552:12345-0@lo:256: 20000000:01000000:1.0:1789607275.659930:0:6462:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789607275.659936:0:6462:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789607275.660037:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003121fc73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+10:6450:x1876539149911552:12345-0@lo:256: Request processed in 131us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.660044:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607275.660146:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911552:0@lo:256: 10000000:01000000:2.0:1789607275.661844:0:6450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607275.661892:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.661905:0:6450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607275.661914:0:6450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c75d7000 from 1 10000000:01000000:2.0:1789607275.661917:0:6450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607275.661954:0:6450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.661970:0:6450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.661981:0:6450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607275.662002:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911680:0@lo:101: 00000100:00100000:2.0:1789607275.662054:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607275.668016:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c15eb301 going to sleep for 11 seconds 00000100:00100000:0.0:1789607275.669370:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911680 00000100:00100000:0.0:1789607275.669382:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911680 00000100:00100000:3.0:1789607275.669481:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607275.669494:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a916e1e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+10:6450:x1876539149911680:12345-0@lo:101: 00010000:00010000:3.0:1789607275.669524:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607275.669542:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd1aa expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.669566:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 11 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.669576:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 11 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.669584:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ddaaddbb, rc 0) 00000100:00100000:3.0:1789607275.669646:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a916e1e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149911680:12345-0@lo:101: Request processed in 156us (7592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607275.669664:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607275.671040:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911680:0@lo:101: 00010000:00010000:2.0:1789607275.671063:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607275.671073:0:6450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607275.671141:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911808:0@lo:501: 00000100:00100000:2.0:1789607275.671186:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607275.671275:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c15eb301 going to sleep for 11 seconds 00000100:00100000:0.0:1789607275.671619:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911808 00000100:00100000:0.0:1789607275.671627:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911808 00000100:00100000:0.0:1789607275.671771:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607275.671779:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ab130ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149911808:12345-0@lo:501: 00000100:00100000:0.0:1789607275.672369:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ab130ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149911808:12345-0@lo:501: Request processed in 590us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607275.672377:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607275.672459:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911808:0@lo:501: 00000100:00100000:2.0:1789607275.672508:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911936:0@lo:503: 00000100:00100000:2.0:1789607275.672549:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607275.682560:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c15eb301 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.682873:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149911936 00000100:00100000:1.0:1789607275.682884:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149911936 00000100:00100000:1.0:1789607275.682937:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607275.682945:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030cf9602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149911936:12345-0@lo:503: 00000040:00080000:1.0:1789607275.683005:0:6462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607275.683080:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030cf9602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149911936:12345-0@lo:503: Request processed in 136us (10531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.683088:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607275.683215:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045148202 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149911936:0@lo:503: 00000040:00080000:2.0:1789607275.684516:0:6495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00010000:00010000:2.0:1789607275.684923:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789607275.685099:0:6450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789607275.685120:0:6450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607275.685138:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.685148:0:6450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607275.685185:0:6450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789607275.685188:0:6450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78c75d7000 10000000:01000000:1.0:1789607275.685363:0:6450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78c75d7000 10000000:01000000:1.0:1789607275.685369:0:6450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607275.685374:0:6450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c75d7000 from 1 10000000:01000000:1.0:1789607275.685376:0:6450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607275.685422:0:6450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.685429:0:6450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.685439:0:6450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607275.685457:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c590586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912064:0@lo:101: 00000100:00100000:1.0:1789607275.685523:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607275.685564:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000915de87b going to sleep for 11 seconds 00000100:00100000:0.0:1789607275.685626:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912064 00000100:00100000:0.0:1789607275.685633:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912064 00000100:00100000:0.0:1789607275.685750:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607275.685759:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007490833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149912064:12345-0@lo:101: 00010000:00010000:0.0:1789607275.685770:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607275.685782:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd1b8 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.685809:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.685818:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.685826:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000737aa8f7, rc 0) 00000100:00100000:0.0:1789607275.685886:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007490833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:6450:x1876539149912064:12345-0@lo:101: Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607275.685893:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607275.685970:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c590586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912064:0@lo:101: 00010000:00010000:1.0:1789607275.685983:0:6450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.685991:0:6450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607275.686032:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c590586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912192:0@lo:501: 00000100:00100000:1.0:1789607275.686055:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607275.686080:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000915de87b going to sleep for 11 seconds 00000100:00100000:0.0:1789607275.686124:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912192 00000100:00100000:0.0:1789607275.686129:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912192 00000100:00100000:0.0:1789607275.686157:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607275.686162:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7073401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:6450:x1876539149912192:12345-0@lo:501: 00000100:00100000:0.0:1789607275.686578:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7073401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:6450:x1876539149912192:12345-0@lo:501: Request processed in 415us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607275.686586:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607275.686737:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c590586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912192:0@lo:501: 00000100:00100000:1.0:1789607275.686765:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c590586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912320:0@lo:503: 00000100:00100000:1.0:1789607275.686808:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607275.686831:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000915de87b going to sleep for 11 seconds 00000100:00100000:0.0:1789607275.689537:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912320 00000100:00100000:0.0:1789607275.689552:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912320 00000100:00100000:0.0:1789607275.689608:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607275.689616:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035c4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:6450:x1876539149912320:12345-0@lo:503: 00000100:00100000:0.0:1789607275.690129:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035c4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:6450:x1876539149912320:12345-0@lo:503: Request processed in 512us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607275.690137:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607275.690421:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c590586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912320:0@lo:503: 00000100:00100000:3.0:1789607275.691319:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001e6db5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6496:1876539149912448:0@lo:502: 00000100:00100000:3.0:1789607275.691379:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.691448:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000697704e1 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.695301:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912448 00000100:00100000:1.0:1789607275.695317:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912448 00000100:00100000:1.0:1789607275.695443:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607275.695450:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001acd6ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:6496:x1876539149912448:12345-0@lo:502: 00000100:00100000:1.0:1789607275.696841:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001acd6ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:6496:x1876539149912448:12345-0@lo:502: Request processed in 1387us (5457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.696856:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607275.697812:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001e6db5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6496:1876539149912448:0@lo:502: 00000020:01000004:3.0:1789607275.697921:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789607275.697951:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e21bcecb) 00000020:00000080:3.0:1789607275.697972:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789607275.698051:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ecd758f2 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789607275.698060:0:6496:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ecd758f2 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789607275.698062:0:6496:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ecd758f2 4 00010000:00080000:3.0:1789607275.698093:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000061c468f8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1789607275.699746:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789607275.699970:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789607275.700002:0:6496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789607275.700015:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa26202d240fbd1cd 00000100:00080000:3.0:1789607275.700024:0:6496:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607275.700032:0:6496:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000061c468f8 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607275.700067:0:6496:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000060b212fb x1876539149912576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607275.700098:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789607275.700146:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060b212fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539149912576:0@lo:38: 00000100:00100000:0.0:1789607275.700360:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.702838:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6496:1876539149912704:0@lo:502: 00000100:00100000:3.0:1789607275.702943:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.702983:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912704 00000100:00100000:3.0:1789607275.702990:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912704 00000100:00100000:3.0:1789607275.703031:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789607275.703038:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce0b80d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:6496:x1876539149912704:12345-0@lo:502: 00000100:00100000:3.0:1789607275.703264:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce0b80d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:6496:x1876539149912704:12345-0@lo:502: Request processed in 225us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607275.703273:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789607275.703324:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af81efd6 going to sleep for 11 seconds 00000100:00100000:3.0:1789607275.703345:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:6496:1876539149912704:0@lo:502: 00000040:00080000:3.0:1789607275.703370:0:6496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789607275.703425:0:6450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789607275.703445:0:6450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607275.703458:0:6450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.703475:0:6450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607275.708343:0:6450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607275.708348:0:6450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607275.708349:0:6450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607275.708350:0:6450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607275.708352:0:6450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607275.708353:0:6450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607275.708355:0:6450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607275.708356:0:6450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607275.708357:0:6450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607275.708358:0:6450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607275.708360:0:6450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607275.708361:0:6450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607275.708364:0:6450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789607275.708367:0:6450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607275.708368:0:6450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607275.708369:0:6450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607275.708371:0:6450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607275.708372:0:6450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607275.708373:0:6450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607275.708374:0:6450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607275.708375:0:6450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607275.708376:0:6450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607275.708377:0:6450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607275.708377:0:6450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607275.708378:0:6450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607275.708404:0:6450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789607275.708421:0:6450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912832:0@lo:253: 00000100:00100000:3.0:1789607275.708487:0:6450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607275.708541:0:6450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af81efd6 going to sleep for 11 seconds 00000100:00100000:2.0:1789607275.708772:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912832 00000100:00100000:2.0:1789607275.708780:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912832 00000100:00100000:2.0:1789607275.708832:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607275.708841:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f036c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:6450:x1876539149912832:12345-0@lo:253: 20000000:01000000:2.0:1789607275.708893:0:6462:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789607275.708905:0:6462:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789607275.709377:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912576 00000100:00100000:1.0:1789607275.709384:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912576 00000100:00100000:1.0:1789607275.709412:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607275.709419:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c59df3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539149912576:12345-0@lo:38: 00000100:00100000:1.0:1789607275.709490:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c59df3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539149912576:12345-0@lo:38: Request processed in 71us (9130us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789607275.709510:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607275.709644:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607275.709651:0:3467:0:(import.c:65:import_set_state_nolock()) 0000000061c468f8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607275.709656:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789607275.709659:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060b212fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539149912576:0@lo:38: 20000000:01000000:0.0:1789607275.767312:0:6462:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607275.767339:0:6462:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789607275.767538:0:6484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789607275.767545:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789607275.767562:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.767581:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd19c expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.767589:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.767639:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd19c expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.767727:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd19c expref: 12 pid: 6464 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607275.767742:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000771798c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149912960:0@lo:104: 00000100:00100000:1.0:1789607275.767803:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607275.767949:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149912960 00000100:00100000:0.0:1789607275.767961:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149912960 00000100:00100000:0.0:1789607275.768013:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607275.768021:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd90d2e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149912960:12345-0@lo:104: 00010000:00010000:0.0:1789607275.768034:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607275.768107:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607275.768112:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd90d2e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149912960:12345-0@lo:104: Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607275.768119:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789607275.768427:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607275.768437:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.768462:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a139eff already unused, calling callback (00000000b1689aef) 10000000:00010000:3.0:1789607275.768465:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.768472:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607275.768482:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607275.768488:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607275.768535:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.768543:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789607275.768843:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149913088:0@lo:103: 00000100:00100000:0.0:1789607275.768909:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607275.770654:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.770668:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 000000007a139eff/0xa26202d240fbd19c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1a3 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.770698:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607275.770700:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607275.770702:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607275.770725:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set 0000000042829015 going to sleep for 11 seconds 00000100:00100000:1.0:1789607275.770760:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000771798c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149912960:0@lo:104: 00010000:00010000:1.0:1789607275.770781:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607275.770816:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913088 00000100:00100000:1.0:1789607275.770822:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913088 00010000:00010000:1.0:1789607275.770849:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd19c expref: 13 pid: 6464 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607275.770897:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607275.770905:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a023deda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+13:3469:x1876539149913088:12345-0@lo:103: 00010000:00010000:1.0:1789607275.770918:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607275.770922:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd19c expref: 13 pid: 6464 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.770931:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd19c expref: 13 pid: 6464 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.770946:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efa1da03/0xa26202d240fbd1a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd19c expref: 13 pid: 6464 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.770971:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.770979:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789607275.770992:0:6454:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003448739s 00010000:00010000:1.0:1789607275.770996:0:6454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.771002:0:6454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.771007:0:6454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.771013:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.771018:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004fcc8fbd already unused, calling callback (0000000051141bff) 00010000:00010000:1.0:1789607275.771022:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.771028:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.777944:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607275.777981:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.785614:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.785635:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd1d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607275.785685:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607275.785766:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a023deda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+12:3469:x1876539149913088:12345-0@lo:103: Request processed in 14860us (16854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607275.785816:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607275.785848:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149913088:0@lo:103: 00000100:00100000:0.0:1789607275.797283:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f036c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+11:6450:x1876539149912832:12345-0@lo:253: Request processed in 88434us (88787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607275.797308:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789607275.799454:0:6450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:6450:1876539149912832:0@lo:253: 10000000:01000000:3.0:1789607275.799474:0:6450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789607275.799477:0:6450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789607275.799479:0:6450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607275.799480:0:6450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607275.799481:0:6450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607275.799482:0:6450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607275.799484:0:6450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607275.799485:0:6450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607275.799486:0:6450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607275.799487:0:6450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607275.799488:0:6450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607275.799489:0:6450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607275.799491:0:6450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789607275.799514:0:6450:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607275.813391:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.814972:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607275.815565:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.815834:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607275.816050:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.816230:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607275.823182:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.823392:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607275.823748:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.823959:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607275.824164:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607275.824634:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789607275.883843:0:6450:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789607275.954278:0:6450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789607275.954883:0:6502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789607275.958775:0:6501:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789607275.958781:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789607275.963124:0:6450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789607275.968379:0:6450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789607275.972655:0:6450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789607275.972675:0:6450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789607275.978203:0:6450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607275.988072:0:6450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789607275.989906:0:6450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789607275.989967:0:6450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789607275.990240:0:6450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789607275.990679:0:6450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789607275.992040:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789607275.992176:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789607275.992305:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789607275.992451:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789607276.001094:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789607276.001331:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789607276.001550:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789607276.001969:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789607276.002112:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789607276.002276:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789607276.002423:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789607276.003396:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789607276.003624:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789607276.008468:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789607276.010296:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789607276.013365:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789607276.015294:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789607276.015461:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789607276.015619:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789607276.016470:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789607276.016826:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789607276.017331:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789607276.017618:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789607276.017902:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789607276.018098:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789607276.018255:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789607276.018393:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789607276.018846:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789607276.020212:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789607276.020372:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789607276.020531:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789607276.020888:0:6450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789607276.021137:0:6450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789607276.041232:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789607276.100256:0:6450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789607276.100293:0:6450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa81b01cb7988 00100000:10000000:2.0:1789607276.100301:0:6450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789607276.100808:0:6450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789607276.100822:0:6450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789607276.100835:0:6450:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789607276.100880:0:6450:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789607276.117638:0:6502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789607276.117776:0:6502:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1789607276.117780:0:6502:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789607276.706278:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607277.731028:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607278.754577:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607279.780655:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607280.208765:0:6745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789607280.802161:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607280.869624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789607280.869632:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789607280.869635:0:36:0:(import.c:65:import_set_state_nolock()) 0000000061c468f8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607280.869652:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000061c468f8 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607280.869671:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fb9cde16 x1876539149913344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607280.869744:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607280.869756:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149913216:0@lo:400: 00000100:00100000:3.0:1789607280.869829:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607280.869914:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913216 00000100:00100000:3.0:1789607280.869922:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913216 00000100:00100000:1.0:1789607280.869934:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539149913344:0@lo:38: 00000100:00100000:3.0:1789607280.869965:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607280.869975:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607280.869978:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e67ea489 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+11:3471:x1876539149913216:12345-0@lo:400: 00000100:00100000:3.0:1789607280.870034:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e67ea489 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+11:3471:x1876539149913216:12345-0@lo:400: Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607280.870040:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607280.870056:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149913216:0@lo:400: 00000100:00100000:2.0:1789607280.870391:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913344 00000100:00100000:2.0:1789607280.870397:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913344 00000100:00100000:2.0:1789607280.870426:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607280.870438:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000771798c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539149913344:12345-0@lo:38: 00010000:00080000:2.0:1789607280.870473:0:6470:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1789607280.870511:0:6470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa26202d240fbd1db 00000004:00100000:2.0:1789607280.870548:0:6470:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789607280.870663:0:6470:0:(import.c:65:import_set_state_nolock()) 000000009a40abaf : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607280.870721:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000771798c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3467:x1876539149913344:12345-0@lo:38: Request processed in 282us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607280.870728:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789607280.872624:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fb9cde16 x1876539149913344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789607280.872644:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789607280.872653:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789607280.872657:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607280.872660:0:3467:0:(import.c:65:import_set_state_nolock()) 0000000061c468f8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607280.872666:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539149913344:0@lo:38: 00010000:00010000:0.0:1789607281.827252:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789607281.889979:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789607281.889988:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c75d7000 from 3 10000000:01000000:0.0:1789607281.889998:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789607281.890035:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607281.890047:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607281.890058:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607281.890080:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063acf232 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149913472:0@lo:101: 00000100:00100000:0.0:1789607281.890142:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607281.890196:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097999f18 going to sleep for 11 seconds 00000100:00100000:0.0:1789607281.890213:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913472 00000100:00100000:0.0:1789607281.890219:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913472 00000100:00100000:0.0:1789607281.890257:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607281.890265:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091a90d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+11:6466:x1876539149913472:12345-0@lo:101: 00010000:00010000:0.0:1789607281.890279:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607281.890291:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd1e2 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607281.890312:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607281.890322:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607281.890330:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a7a0107, rc 0) 00000100:00100000:0.0:1789607281.890363:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091a90d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:6466:x1876539149913472:12345-0@lo:101: Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607281.890388:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607281.890849:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063acf232 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149913472:0@lo:101: 00010000:00010000:0.0:1789607281.890990:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607281.890999:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607281.891047:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063acf232 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149913600:0@lo:256: 00000100:00100000:0.0:1789607281.891081:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607281.891137:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097999f18 going to sleep for 11 seconds 00000100:00100000:3.0:1789607281.896292:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913600 00000100:00100000:3.0:1789607281.896308:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913600 00000100:00100000:3.0:1789607281.896391:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607281.896399:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003dcd9520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:6466:x1876539149913600:12345-0@lo:256: 20000000:01000000:3.0:1789607281.896435:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607281.896450:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607281.896460:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789607281.896740:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003dcd9520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:6466:x1876539149913600:12345-0@lo:256: Request processed in 342us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607281.896748:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607281.897961:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063acf232 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149913600:0@lo:256: 10000000:01000000:2.0:1789607281.898039:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607281.898050:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607281.898061:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607282.850850:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607283.874692:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607284.902705:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607285.932927:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607285.986277:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000001ff94d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149913728:0@lo:400: 00000100:00100000:3.0:1789607285.986438:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607285.986786:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913728 00000100:00100000:1.0:1789607285.986797:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913728 00000100:00100000:1.0:1789607285.986885:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607285.986895:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000934e62e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:3471:x1876539149913728:12345-0@lo:400: 00000100:00100000:1.0:1789607285.986964:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000934e62e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:3471:x1876539149913728:12345-0@lo:400: Request processed in 71us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607285.986983:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607285.987126:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf8e1b5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149913856:0@lo:400: 00000100:00100000:2.0:1789607285.987181:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607285.987903:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000001ff94d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149913728:0@lo:400: 00000100:00100000:1.0:1789607285.988009:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913856 00000100:00100000:1.0:1789607285.988017:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913856 00000100:00100000:1.0:1789607285.988061:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607285.988070:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045148202 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149913856:12345-0@lo:400: 00000100:00100000:1.0:1789607285.988150:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045148202 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149913856:12345-0@lo:400: Request processed in 82us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607285.988159:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789607285.988375:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bf8e1b5d x1876539149913856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607285.988391:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf8e1b5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149913856:0@lo:400: 00010000:00010000:1.0:1789607286.947713:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607287.971022:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607288.995906:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607290.018054:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607291.053349:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607291.113150:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149914112:0@lo:400: 00000100:00100000:2.0:1789607291.113245:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607291.113345:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914112 00000100:00100000:2.0:1789607291.113356:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914112 00000100:00100000:2.0:1789607291.113424:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607291.113433:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000771fada3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149914112:12345-0@lo:400: 00000100:00100000:2.0:1789607291.113495:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000771fada3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149914112:12345-0@lo:400: Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607291.113520:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789607291.113569:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a4afa564 x1876539149914112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607291.113586:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149914112:0@lo:400: 00000100:00100000:3.0:1789607291.113660:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ab6ed4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149913984:0@lo:400: 00000100:00100000:3.0:1789607291.113701:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607291.114130:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149913984 00000100:00100000:2.0:1789607291.114138:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149913984 00000100:00100000:2.0:1789607291.114487:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607291.114498:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023544d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:3469:x1876539149913984:12345-0@lo:400: 00000100:00100000:2.0:1789607291.114568:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023544d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:3469:x1876539149913984:12345-0@lo:400: Request processed in 72us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607291.114574:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789607291.119846:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ab6ed4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149913984:0@lo:400: 00010000:00010000:3.0:1789607292.066062:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789607293.063625:0:7259:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789607293.063629:0:7259:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:1.0:1789607293.063735:0:7259:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bc600d0a 00000020:01000004:1.0:1789607293.063752:0:7259:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789607293.063763:0:7259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789607293.063777:0:7259:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000001089d7b9) 00000020:00000080:1.0:1789607293.063793:0:7259:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789607293.088857:0:7259:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1789607293.089276:0:7259:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00010000:00010000:1.0:1789607293.090696:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789607293.108052:0:7259:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789607293.108096:0:7259:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789607293.108119:0:7259:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789607293.108181:0:7259:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789607293.108208:0:7259:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789607293.108609:0:7259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789607293.108620:0:7259:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789607293.108629:0:7259:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbd1f7 00000020:01000004:1.0:1789607293.108637:0:7259:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:1.0:1789607293.108655:0:7259:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789607293.108658:0:7259:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789607293.108663:0:7259:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789607293.108695:0:7259:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:1.0:1789607293.108699:0:7259:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789607293.142939:0:7259:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789607293.142979:0:7259:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789607293.142983:0:7259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789607293.142985:0:7259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789607293.142986:0:7259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607293.142988:0:7259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607293.142989:0:7259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607293.142990:0:7259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607293.142992:0:7259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607293.142993:0:7259:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607293.142994:0:7259:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607293.142996:0:7259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607293.142997:0:7259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607293.143000:0:7259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789607293.143002:0:7259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789607293.143008:0:7259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789607293.143009:0:7259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607293.143010:0:7259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607293.143011:0:7259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607293.143012:0:7259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607293.143012:0:7259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607293.143013:0:7259:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607293.143014:0:7259:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607293.143015:0:7259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607293.143016:0:7259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607293.143045:0:7259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789607293.143061:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149914240:0@lo:253: 00000100:00100000:0.0:1789607293.143134:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.143487:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c085a719 going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.144505:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914240 00000100:00100000:3.0:1789607293.144517:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914240 00000100:00100000:3.0:1789607293.145530:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607293.145546:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e04ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149914240:12345-0@lo:253: 20000000:01000000:3.0:1789607293.145593:0:6462:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789607293.145598:0:6462:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789607293.145603:0:6462:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789607293.145607:0:6462:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789607293.145921:0:6462:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789607293.147114:0:6462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607293.147787:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789607293.147804:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789607293.147850:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789607293.147938:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789607293.147978:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789607293.148084:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789607293.148094:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789607293.148141:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789607293.148158:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789607293.148701:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789607293.148709:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789607293.148742:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789607293.148792:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789607293.149794:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789607293.149808:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:3.0:1789607293.149834:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789607293.149841:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789607293.150141:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789607293.150152:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:3.0:1789607293.150193:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789607293.150311:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789607293.150414:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789607293.150479:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789607293.150512:0:6462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789607293.150947:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789607293.150959:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789607293.150992:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789607293.151045:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789607293.151087:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789607293.151095:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789607293.151121:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789607293.151519:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789607293.151530:0:6462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789607293.151690:0:6462:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789607293.151698:0:6462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789607293.156729:0:7262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789607293.157337:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789607293.157387:0:6462:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.125@tcp for mdt 20000000:01000000:3.0:1789607293.157390:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:3.0:1789607293.157438:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789607293.157446:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789607293.157477:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789607293.157484:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:3.0:1789607293.157527:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789607293.157537:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789607293.157583:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789607293.157620:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789607293.157818:0:6462:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789607293.157827:0:6462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789607293.159770:0:7263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789607293.160243:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789607293.160269:0:6462:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.125@tcp for mdt 20000000:01000000:0.0:1789607293.160271:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:0.0:1789607293.160308:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789607293.160316:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789607293.160393:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789607293.160403:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:0.0:1789607293.160436:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789607293.160447:0:6462:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789607293.160474:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789607293.160522:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789607293.160558:0:6462:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789607293.160561:0:6462:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789607293.160567:0:6462:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789607293.160574:0:6462:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789607293.162134:0:7264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 22 20000000:00000400:0.0:1789607293.163423:0:6462:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 20000000:01000000:0.0:1789607293.195721:0:6462:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789607293.195728:0:6462:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789607293.195732:0:6462:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789607293.210445:0:6462:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789607293.210453:0:6462:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789607293.210503:0:6462:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789607293.210504:0:6462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607293.213752:0:7265:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607293.213825:0:7265:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607293.214118:0:7265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789607293.214632:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789607293.214679:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789607293.214754:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789607293.214770:0:6462:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789607293.214773:0:6462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789607293.215768:0:7266:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789607293.215827:0:7266:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789607293.215890:0:7266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789607293.216437:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789607293.216480:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789607293.216516:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789607293.216653:0:6462:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789607293.216656:0:6462:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789607293.217090:0:7267:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789607293.217133:0:7267:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789607293.217186:0:7267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789607293.217505:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789607293.217557:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789607293.217616:0:6462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1789607293.217635:0:6462:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789607293.217654:0:6462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217674:0:6462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd12c expref: 12 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217693:0:6462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd148 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217700:0:6462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217706:0:6462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217744:0:6462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217757:0:6462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 12 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.217770:0:6462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6462:1876539149914368:0@lo:104: 00000100:00100000:2.0:1789607293.217831:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607293.217907:0:6462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd148 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217915:0:6462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd148 expref: 12 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.217923:0:6462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014d300c7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6462:1876539149914496:0@lo:104: 00000100:00100000:2.0:1789607293.217944:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607293.217971:0:6462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd12c expref: 12 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.217979:0:6462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd12c expref: 12 pid: 6463 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.217993:0:6462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004854721b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6462:1876539149914624:0@lo:104: 00000100:00100000:2.0:1789607293.218015:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607293.218025:0:6462:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cedbb87 going to sleep for 11 seconds 00000100:00100000:0.0:1789607293.218230:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914368 00000100:00100000:0.0:1789607293.218238:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914368 00000100:00100000:0.0:1789607293.218272:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914496 00000100:00100000:0.0:1789607293.218275:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914496 00000100:00100000:0.0:1789607293.218285:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914624 00000100:00100000:0.0:1789607293.218287:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914624 00000100:00100000:0.0:1789607293.218298:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607293.218305:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074e49082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:6462:x1876539149914368:12345-0@lo:104: 00010000:00010000:0.0:1789607293.218317:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.218397:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607293.218402:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074e49082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:6462:x1876539149914368:12345-0@lo:104: Request processed in 98us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607293.218409:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607293.218425:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607293.218430:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005621cf1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6462:x1876539149914496:12345-0@lo:104: 00000100:00100000:2.0:1789607293.218437:0:6462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6462:1876539149914368:0@lo:104: 00010000:00010000:0.0:1789607293.218437:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.218481:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789607293.218486:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005621cf1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6462:x1876539149914496:12345-0@lo:104: Request processed in 56us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607293.218501:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607293.218514:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607293.218519:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bfeaca5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6462:x1876539149914624:12345-0@lo:104: 00010000:00010000:0.0:1789607293.218526:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.218553:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789607293.218557:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bfeaca5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6462:x1876539149914624:12345-0@lo:104: Request processed in 39us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607293.218563:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789607293.218594:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607293.218600:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218608:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000912eea45 already unused, calling callback (00000000b1689aef) 10000000:00010000:1.0:1789607293.218610:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218616:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607293.218623:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607293.218628:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607293.218667:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218674:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607293.218702:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218707:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000912eea45/0xa26202d240fbd1b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1bf expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218719:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607293.218722:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218727:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001759cb20 already unused, calling callback (00000000b1689aef) 10000000:00010000:1.0:1789607293.218729:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218734:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607293.218739:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607293.218744:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607293.218756:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218761:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607293.218774:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218779:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 000000001759cb20/0xa26202d240fbd148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd14f expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218789:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607293.218797:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218802:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc828eed already unused, calling callback (00000000b1689aef) 10000000:00010000:1.0:1789607293.218804:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218810:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607293.218814:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607293.218819:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607293.218836:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218842:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607293.218847:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218852:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000bc828eed/0xa26202d240fbd12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd133 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.218890:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607293.218892:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607293.218894:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607293.218905:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000679a79ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149914752:0@lo:103: 00000100:00100000:1.0:1789607293.218937:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607293.219031:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607293.219043:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6dadfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149914880:0@lo:103: 00000100:00100000:0.0:1789607293.219070:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.219101:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607293.219107:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149915008:0@lo:103: 00000100:00100000:2.0:1789607293.219111:0:6462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014d300c7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6462:1876539149914496:0@lo:104: 00000100:00100000:2.0:1789607293.219118:0:6462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004854721b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6462:1876539149914624:0@lo:104: 00000100:00100000:0.0:1789607293.219126:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607293.219136:0:6462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.219151:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914752 00000100:00100000:2.0:1789607293.219155:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914752 00000100:00100000:0.0:1789607293.219171:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149914880 00010000:00010000:2.0:1789607293.219172:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 13 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.219174:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149914880 00010000:00010000:0.0:1789607293.219183:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd148 expref: 14 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.219186:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915008 00000100:00100000:2.0:1789607293.219188:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915008 00000100:00100000:0.0:1789607293.219288:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607293.219297:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075413aa6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+15:3471:x1876539149914752:12345-0@lo:103: 00010000:00010000:0.0:1789607293.219309:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607293.219313:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.219322:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.219340:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000737aa8f7/0xa26202d240fbd1bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd1b8 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.219349:0:6454:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789607293.219356:0:6454:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789607293.219361:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607293.219382:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd12c expref: 14 pid: 6463 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.219429:0:6456:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789607293.219437:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607293.219443:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1fad881 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+14:3468:x1876539149914880:12345-0@lo:103: 00010000:00010000:2.0:1789607293.219450:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607293.219457:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd148 expref: 14 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219464:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd148 expref: 14 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219479:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a49b9ca/0xa26202d240fbd14f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd148 expref: 14 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219488:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607293.219534:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1fad881 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+13:3468:x1876539149914880:12345-0@lo:103: Request processed in 92us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.219541:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607293.219553:0:6456:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789607293.219558:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607293.219571:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a84a5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+12:3468:x1876539149915008:12345-0@lo:103: 00010000:00010000:2.0:1789607293.219578:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607293.219581:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd12c expref: 12 pid: 6463 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219588:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd12c expref: 12 pid: 6463 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219597:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ad80e5a/0xa26202d240fbd133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd12c expref: 12 pid: 6463 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219605:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219612:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219622:0:6456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219628:0:6456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219638:0:6456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219643:0:6456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219648:0:6456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000071b9e9c already unused, calling callback (0000000051141bff) 00010000:00010000:2.0:1789607293.219650:0:6456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219656:0:6456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219663:0:6456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219670:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607293.219691:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a84a5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+11:3468:x1876539149915008:12345-0@lo:103: Request processed in 120us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.219697:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789607293.219712:0:6462:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219718:0:6462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.219724:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd1fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789607293.219739:0:6462:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789607293.220701:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149915008:0@lo:103: 00000100:00100000:1.0:1789607293.220728:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6dadfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149914880:0@lo:103: 00000100:00100000:0.0:1789607293.228449:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075413aa6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+10:3471:x1876539149914752:12345-0@lo:103: Request processed in 9146us (9503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607293.228465:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607293.237019:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000679a79ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149914752:0@lo:103: 00000100:00100000:2.0:1789607293.279170:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e04ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+9:7259:x1876539149914240:12345-0@lo:253: Request processed in 133612us (136017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.279186:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607293.279485:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149914240:0@lo:253: 10000000:01000000:0.0:1789607293.279501:0:7259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789607293.279504:0:7259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607293.279507:0:7259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789607293.279508:0:7259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607293.279509:0:7259:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789607293.279511:0:7259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607293.279512:0:7259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607293.279513:0:7259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607293.279514:0:7259:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789607293.279515:0:7259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607293.279517:0:7259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607293.279621:0:7259:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc600d0a from lustre-MDT0001 10000000:01000000:0.0:1789607293.279648:0:7259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789607293.279650:0:7259:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789607293.279657:0:7259:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78e9ee99c0 local copy 10000000:01000000:0.0:1789607293.279661:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789607293.279693:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.279703:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.279711:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.279741:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915136:0@lo:101: 00000100:00100000:0.0:1789607293.279777:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.279832:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3c8fbbc going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.280002:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915136 00000100:00100000:2.0:1789607293.280008:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915136 00000100:00100000:2.0:1789607293.280092:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607293.280101:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5315c6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+9:7259:x1876539149915136:12345-0@lo:101: 00010000:00010000:2.0:1789607293.280114:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607293.280126:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd20c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd205 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.280149:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd205 expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.280171:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd205 expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.280179:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000071b9e9c, rc 0) 00000100:00100000:2.0:1789607293.280218:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5315c6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+10:7259:x1876539149915136:12345-0@lo:101: Request processed in 119us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.280224:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789607293.280300:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915136:0@lo:101: 00010000:00010000:0.0:1789607293.280312:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.280320:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.280452:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915264:0@lo:501: 00000100:00100000:0.0:1789607293.280476:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.281141:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3c8fbbc going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.281226:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915264 00000100:00100000:3.0:1789607293.281232:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915264 00000100:00100000:3.0:1789607293.281260:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607293.281266:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087957ab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+10:7259:x1876539149915264:12345-0@lo:501: 00000100:00100000:3.0:1789607293.281717:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087957ab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+10:7259:x1876539149915264:12345-0@lo:501: Request processed in 450us (1239us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607293.281731:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789607293.281820:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915264:0@lo:501: 10000000:01000000:0.0:1789607293.281848:0:7259:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789607293.281910:0:7259:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789607293.281916:0:7259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.281925:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.281931:0:7259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.281946:0:7259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789607293.281972:0:7259:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78f05a9800 10000000:01000000:0.0:1789607293.281983:0:7259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789607293.281988:0:7259:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d78e9ee99c0 10000000:01000000:0.0:1789607293.281990:0:7259:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789607293.281993:0:7259:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d78e9ee99c0 from 1 10000000:01000000:0.0:1789607293.281996:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789607293.282020:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.282027:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.282036:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.282051:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915392:0@lo:101: 00000100:00100000:0.0:1789607293.282080:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.282101:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000586a1f38 going to sleep for 11 seconds 00010000:00010000:3.0:1789607293.282294:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607293.282300:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282307:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d231dde1 already unused, calling callback (00000000b1689aef) 10000000:00010000:3.0:1789607293.282309:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282316:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607293.282322:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.282327:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607293.282355:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282362:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607293.282392:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282399:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000d231dde1/0xa26202d240fbd205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd20c expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282413:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607293.282415:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607293.282416:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607293.282426:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915392 00000100:00100000:3.0:1789607293.282437:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915392 00000100:00100000:3.0:1789607293.282461:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607293.282467:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c4da46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+10:7259:x1876539149915392:12345-0@lo:101: 00010000:00010000:3.0:1789607293.282477:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607293.282487:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a139eff/0xa26202d240fbd21a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd213 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282507:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a139eff/0xa26202d240fbd21a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd213 expref: 11 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282516:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a139eff/0xa26202d240fbd21a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd213 expref: 11 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282712:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a139eff, rc 0) 00000100:00100000:3.0:1789607293.282756:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c4da46e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+11:7259:x1876539149915392:12345-0@lo:101: Request processed in 289us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.282761:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607293.282800:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e75f62f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915392:0@lo:101: 00010000:00010000:3.0:1789607293.282813:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282820:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.282846:0:7259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789607293.282856:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282895:0:7259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000008d2320e8/0xa26202d240fbd213 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.282910:0:7259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d78f05a9800 10000000:01000000:3.0:1789607293.282913:0:7259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789607293.282917:0:7259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d78f05a9800 from 1 10000000:01000000:3.0:1789607293.282919:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789607293.282934:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282941:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.282948:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.282959:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ef8b8eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915648:0@lo:101: 00000100:00100000:3.0:1789607293.282985:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.283007:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000108081fb going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.283036:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915648 00000100:00100000:3.0:1789607293.283039:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915648 00000100:00100000:3.0:1789607293.283058:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607293.283064:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0ca7b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+11:7259:x1876539149915648:12345-0@lo:101: 00010000:00010000:3.0:1789607293.283071:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607293.283078:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056d266f0/0xa26202d240fbd228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd221 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283093:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056d266f0/0xa26202d240fbd228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd221 expref: 12 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283100:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056d266f0/0xa26202d240fbd228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd221 expref: 12 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283112:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056d266f0, rc 0) 00000100:00100000:3.0:1789607293.283139:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0ca7b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149915648:12345-0@lo:101: Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.283144:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607293.283427:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ef8b8eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915648:0@lo:101: 00010000:00010000:3.0:1789607293.283438:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283445:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.283456:0:7259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789607293.283463:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283470:0:7259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000006718160d/0xa26202d240fbd221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.283476:0:7259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789607293.283479:0:7259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607293.283484:0:7259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d78f05a9800 10000000:01000000:3.0:1789607293.283486:0:7259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789607293.283489:0:7259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789607293.283491:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789607293.283506:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283512:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283602:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.283616:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ef8b8eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915776:0@lo:101: 00000100:00100000:3.0:1789607293.283643:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.283657:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000108081fb going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.283675:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915776 00000100:00100000:3.0:1789607293.283679:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915776 00000100:00100000:3.0:1789607293.283698:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607293.283703:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c5c3110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149915776:12345-0@lo:101: 00010000:00010000:3.0:1789607293.283710:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607293.283717:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c828cb4b/0xa26202d240fbd236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd22f expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283730:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c828cb4b/0xa26202d240fbd236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd22f expref: 13 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283738:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c828cb4b/0xa26202d240fbd236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd22f expref: 13 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.283744:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c828cb4b, rc 0) 00000100:00100000:3.0:1789607293.283772:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c5c3110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+13:7259:x1876539149915776:12345-0@lo:101: Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.283778:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607293.283809:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ef8b8eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915776:0@lo:101: 00010000:00010000:3.0:1789607293.283818:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.283939:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149915520:0@lo:103: 00000100:00100000:0.0:1789607293.283970:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607293.284130:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.284489:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915520 00000100:00100000:2.0:1789607293.284494:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915520 00000100:00100000:2.0:1789607293.284544:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607293.284550:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5104386 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+13:3470:x1876539149915520:12345-0@lo:103: 00010000:00010000:2.0:1789607293.284560:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607293.284572:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000071b9e9c/0xa26202d240fbd20c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd205 expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.284591:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607293.284630:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5104386 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+12:3470:x1876539149915520:12345-0@lo:103: Request processed in 80us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.284636:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607293.284664:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149915520:0@lo:103: 00000100:00100000:3.0:1789607293.284824:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ef8b8eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915904:0@lo:501: 00000100:00100000:3.0:1789607293.284892:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.284914:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000108081fb going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.285071:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149915904 00000100:00100000:2.0:1789607293.285076:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149915904 00000100:00100000:2.0:1789607293.285107:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607293.285113:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c49016c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149915904:12345-0@lo:501: 00000100:00100000:2.0:1789607293.285619:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c49016c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149915904:12345-0@lo:501: Request processed in 506us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.285626:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789607293.285703:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ef8b8eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149915904:0@lo:501: 00000100:00100000:0.0:1789607293.285735:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f790c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916032:0@lo:503: 00000100:00100000:0.0:1789607293.285776:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.285799:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bfbcfe04 going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.285892:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916032 00000100:00100000:3.0:1789607293.285898:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916032 00000100:00100000:3.0:1789607293.285918:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607293.285924:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9991493 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916032:12345-0@lo:503: 00000100:00100000:3.0:1789607293.286061:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9991493 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916032:12345-0@lo:503: Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.286068:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607293.286258:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f790c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916032:0@lo:503: 00000040:00080000:0.0:1789607293.286728:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607293.286782:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f790c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916160:0@lo:502: 00000100:00100000:0.0:1789607293.286822:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.286895:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bfbcfe04 going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.287050:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916160 00000100:00100000:2.0:1789607293.287055:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916160 00000100:00100000:2.0:1789607293.287079:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607293.287085:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073cace3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916160:12345-0@lo:502: 00000100:00100000:2.0:1789607293.287705:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073cace3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916160:12345-0@lo:502: Request processed in 618us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.287713:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607293.287803:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f790c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916160:0@lo:502: 00000040:00080000:0.0:1789607293.288130:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789607293.288726:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789607293.288787:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789607293.288826:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789607293.289000:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789607293.289070:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789607293.289110:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789607293.289142:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789607293.289503:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789607293.289627:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789607293.289662:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789607293.289715:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789607293.289753:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789607293.289785:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789607293.289835:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789607293.290776:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789607293.290815:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789607293.292492:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789607293.292824:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789607293.292979:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789607293.293039:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789607293.293076:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789607293.293109:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789607293.293269:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f790c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916288:0@lo:502: 00000100:00100000:0.0:1789607293.293490:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.293650:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bfbcfe04 going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.293698:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916288 00000100:00100000:2.0:1789607293.293706:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916288 00000100:00100000:2.0:1789607293.293788:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607293.293797:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b91e909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916288:12345-0@lo:502: 00000100:00100000:2.0:1789607293.294055:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b91e909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916288:12345-0@lo:502: Request processed in 259us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.294073:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607293.294175:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f790c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916288:0@lo:502: 00000040:00080000:1.0:1789607293.294294:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1789607293.294305:0:7259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789607293.295489:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607293.295501:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607293.295504:0:7269:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789607293.295509:0:7269:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789607293.295589:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789607293.295606:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000ea39f848) 00000020:00000080:0.0:1789607293.295626:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789607293.295634:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789607293.295722:0:7269:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789607293.295729:0:7269:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbd244 00000020:00000080:0.0:1789607293.295981:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789607293.295986:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607293.295990:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607293.295991:0:7269:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789607293.295994:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607293.295998:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607293.296000:0:7269:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789607293.296002:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789607293.296009:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000c26f196c) 00000020:00000080:0.0:1789607293.296020:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789607293.296025:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789607293.296026:0:7269:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789607293.296029:0:7269:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789607293.296035:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789607293.296076:0:7269:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc600d0a from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789607293.296089:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000009fa0b245) 00000020:00000080:0.0:1789607293.296097:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789607293.296650:0:7269:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789607293.296657:0:7269:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd259 00000020:00000080:0.0:1789607293.296764:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789607293.296770:0:7269:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789607293.296774:0:7269:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa26202d240fbd260 00080000:01000000:0.0:1789607293.296780:0:7269:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789607293.296783:0:7269:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbd267 00080000:10000000:0.0:1789607293.297261:0:7269:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789607293.297653:0:7269:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789607293.436653:0:7269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789607293.436989:0:7269:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789607293.444720:0:7269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789607293.445216:0:7269:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789607293.627600:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789607293.627613:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607293.627618:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607293.627621:0:7269:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789607293.627625:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607293.627631:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607293.627632:0:7269:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789607293.627635:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789607293.627640:0:7269:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:00000080:3.0:1789607293.627666:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607293.627680:0:7269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000004a10ea1b) 00000020:00000080:3.0:1789607293.627703:0:7269:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789607293.627708:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789607293.627768:0:7269:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789607293.627775:0:7269:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789607293.627795:0:7269:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbd275 00010000:00080000:3.0:1789607293.627825:0:7269:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e604ec9e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1789607293.630241:0:7269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1789607293.631613:0:7269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607293.631626:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789607293.631655:0:7269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789607293.631675:0:7269:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd27c 00000100:00080000:2.0:1789607293.631684:0:7269:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607293.631695:0:7269:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000e604ec9e using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607293.631731:0:7269:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004854721b x1876539149916416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607293.631756:0:7269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789607293.631809:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607293.631814:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607293.631816:0:7269:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789607293.631818:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607293.631820:0:7269:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789607293.631822:0:7269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607293.631823:0:7269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607293.631825:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607293.631827:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607293.631828:0:7269:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607293.631830:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607293.631834:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607293.631835:0:7269:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789607293.631839:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789607293.631887:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607293.631899:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6dadfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149916544:0@lo:400: 00000100:00100000:2.0:1789607293.631962:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607293.632025:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916544 00000100:00100000:2.0:1789607293.632032:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916544 00000100:00100000:2.0:1789607293.632070:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607293.632077:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014d300c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149916544:12345-0@lo:400: 00000100:00100000:2.0:1789607293.632121:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014d300c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149916544:12345-0@lo:400: Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.632127:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789607293.632160:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002f6dadfd x1876539149916544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607293.632172:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6dadfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149916544:0@lo:400: 00000004:01000000:2.0:1789607293.632191:0:7269:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789607293.632205:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607293.632208:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607293.632209:0:7269:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789607293.632211:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607293.632214:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607293.632215:0:7269:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607293.632217:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607293.632219:0:7269:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789607293.632298:0:7269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607293.632301:0:7269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607293.632303:0:7269:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607293.632305:0:7269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1789607293.632351:0:7259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1789607293.632388:0:7259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789607293.632400:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632419:0:7259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000007d3ee2bf/0xa26202d240fbd22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607293.632427:0:7259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78f05a9800 from 1 10000000:01000000:2.0:1789607293.632429:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607293.632450:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632456:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632465:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.632478:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916672:0@lo:101: 00000100:00100000:2.0:1789607293.632502:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607293.632522:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039c05067 going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.632543:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916672 00000100:00100000:2.0:1789607293.632546:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916672 00000100:00100000:2.0:1789607293.632567:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607293.632572:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002dbd347d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+12:7259:x1876539149916672:12345-0@lo:101: 00010000:00010000:2.0:1789607293.632579:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607293.632588:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd283 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632607:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd283 expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632615:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd283 expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632628:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001a0a637, rc 0) 00000100:00100000:2.0:1789607293.632653:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002dbd347d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+13:7259:x1876539149916672:12345-0@lo:101: Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.632658:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607293.632687:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916672:0@lo:101: 00010000:00010000:2.0:1789607293.632697:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.632704:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.633197:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916800:0@lo:256: 00000100:00100000:2.0:1789607293.633231:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607293.633246:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039c05067 going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.633260:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916800 00000100:00100000:2.0:1789607293.633264:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916800 00000100:00100000:2.0:1789607293.633292:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607293.633299:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093b3be86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+13:7259:x1876539149916800:12345-0@lo:256: 20000000:01000000:2.0:1789607293.633312:0:6463:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789607293.633327:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789607293.633331:0:6463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789607293.633420:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093b3be86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+13:7259:x1876539149916800:12345-0@lo:256: Request processed in 122us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.633427:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789607293.633431:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916800:0@lo:256: 00000100:00100000:3.0:1789607293.633534:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004854721b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539149916416:0@lo:38: 00000100:00100000:3.0:1789607293.633566:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.633739:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916416 00000100:00100000:1.0:1789607293.633743:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916416 00000100:00100000:1.0:1789607293.633799:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607293.633803:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc4f1628 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539149916416:12345-0@lo:38: 00010000:00080000:1.0:1789607293.633820:0:6473:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1789607293.633853:0:6473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd291 00000004:00100000:1.0:1789607293.633884:0:6473:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789607293.633889:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:0.0:1789607293.634009:0:7259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789607293.634020:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.634028:0:7259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607293.634035:0:7259:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f05a9800 from 1 10000000:01000000:0.0:1789607293.634038:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789607293.634058:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.634064:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.634072:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.634085:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000443ccb47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916928:0@lo:101: 00000100:00100000:0.0:1789607293.634115:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.634454:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba45711f going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.634488:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149916928 00000100:00100000:2.0:1789607293.634492:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149916928 00000100:00100000:2.0:1789607293.634520:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607293.634525:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae490f50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+13:7259:x1876539149916928:12345-0@lo:101: 00010000:00010000:2.0:1789607293.634534:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607293.634542:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd298 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.634560:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd298 expref: 14 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.634569:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd298 expref: 14 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.634576:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030c60999, rc 0) 00000100:00100000:2.0:1789607293.634651:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae490f50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+14:7259:x1876539149916928:12345-0@lo:101: Request processed in 125us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.634657:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789607293.634708:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000443ccb47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149916928:0@lo:101: 00010000:00010000:0.0:1789607293.634719:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607293.634726:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607293.634978:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000443ccb47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917056:0@lo:501: 00000100:00100000:0.0:1789607293.635007:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.635064:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba45711f going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.635095:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917056 00000100:00100000:2.0:1789607293.635100:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917056 00000100:00100000:2.0:1789607293.635121:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607293.635127:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029dc8b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:7259:x1876539149917056:12345-0@lo:501: 00000100:00100000:2.0:1789607293.635394:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029dc8b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:7259:x1876539149917056:12345-0@lo:501: Request processed in 267us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.635401:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789607293.635444:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000443ccb47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917056:0@lo:501: 00000100:00100000:0.0:1789607293.635468:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000443ccb47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917184:0@lo:503: 00000100:00100000:0.0:1789607293.635505:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.635552:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba45711f going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.635582:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917184 00000100:00100000:2.0:1789607293.635586:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917184 00000100:00100000:2.0:1789607293.635640:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789607293.635646:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008787b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:7259:x1876539149917184:12345-0@lo:503: 00000040:00080000:2.0:1789607293.635678:0:6463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607293.635727:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008787b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:7259:x1876539149917184:12345-0@lo:503: Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.635734:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607293.635797:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000443ccb47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917184:0@lo:503: 00000040:00080000:3.0:1789607293.636720:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607293.636764:0:7259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789607293.636835:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607293.637634:0:7275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789607293.638577:0:7259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789607293.638612:0:7259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607293.638664:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.638677:0:7259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.638719:0:7259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789607293.638722:0:7259:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78f05a9800 10000000:01000000:3.0:1789607293.638725:0:7259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78f05a9800 10000000:01000000:3.0:1789607293.638729:0:7259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607293.638734:0:7259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78f05a9800 from 1 10000000:01000000:3.0:1789607293.638737:0:7259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607293.638766:0:7259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.638774:0:7259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.638783:0:7259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.638810:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3c76312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917312:0@lo:101: 00000100:00100000:3.0:1789607293.638889:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.638925:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9e77791 going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.639158:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917312 00000100:00100000:2.0:1789607293.639166:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917312 00000100:00100000:2.0:1789607293.639206:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789607293.639216:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffa40a90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+14:7259:x1876539149917312:12345-0@lo:101: 00010000:00010000:2.0:1789607293.639228:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607293.639239:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc828eed/0xa26202d240fbd2ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd2a6 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.639264:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc828eed/0xa26202d240fbd2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.639274:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc828eed/0xa26202d240fbd2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.639281:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc828eed, rc 0) 00000100:00100000:2.0:1789607293.639320:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffa40a90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917312:12345-0@lo:101: Request processed in 105us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.639330:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789607293.639469:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3c76312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917312:0@lo:101: 00010000:00010000:2.0:1789607293.639482:0:7259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607293.639489:0:7259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.639568:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001935818d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917440:0@lo:501: 00000100:00100000:2.0:1789607293.639592:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607293.639621:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f56a436d going to sleep for 11 seconds 00000100:00100000:0.0:1789607293.639689:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917440 00000100:00100000:0.0:1789607293.639693:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917440 00000100:00100000:0.0:1789607293.639722:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789607293.639728:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089b3c0a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917440:12345-0@lo:501: 00000100:00100000:0.0:1789607293.639893:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089b3c0a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917440:12345-0@lo:501: Request processed in 165us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607293.639900:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607293.640020:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001935818d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917440:0@lo:501: 00000100:00100000:1.0:1789607293.640056:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917568:0@lo:503: 00000100:00100000:1.0:1789607293.640101:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.640202:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b4bf2ff going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.640233:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917568 00000100:00100000:2.0:1789607293.640237:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917568 00000100:00100000:2.0:1789607293.640293:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789607293.640300:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049a9fe9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917568:12345-0@lo:503: 00000100:00100000:2.0:1789607293.640529:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049a9fe9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917568:12345-0@lo:503: Request processed in 229us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.640536:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607293.640643:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917568:0@lo:503: 00000040:00080000:0.0:1789607293.641523:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607293.641593:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd77c56d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917696:0@lo:502: 00000100:00100000:0.0:1789607293.641646:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.641853:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 000000009371c353 going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.642011:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917696 00000100:00100000:3.0:1789607293.642019:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917696 00000100:00100000:3.0:1789607293.642066:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607293.642073:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054aa4f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917696:12345-0@lo:502: 00000100:00100000:3.0:1789607293.642394:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054aa4f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917696:12345-0@lo:502: Request processed in 320us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.642401:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607293.642672:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd77c56d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917696:0@lo:502: 00000040:00080000:3.0:1789607293.642943:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789607293.642990:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789607293.643024:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789607293.643072:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789607293.643111:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789607293.643160:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789607293.643198:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789607293.643229:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789607293.643479:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789607293.643515:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789607293.643544:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789607293.643590:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789607293.643626:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789607293.643660:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789607293.643746:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789607293.643782:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789607293.643816:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789607293.643976:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789607293.644013:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789607293.644047:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789607293.644094:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789607293.644176:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789607293.644337:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789607293.644557:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789607293.644596:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789607293.644629:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789607293.644679:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789607293.644711:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1789607293.644759:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9542037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917824:0@lo:502: 00000100:00100000:3.0:1789607293.644837:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.644941:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 000000001be9fe4d going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.644983:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917824 00000100:00100000:2.0:1789607293.644991:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917824 00000100:00100000:2.0:1789607293.645036:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789607293.645043:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba494cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917824:12345-0@lo:502: 00000100:00100000:2.0:1789607293.645342:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba494cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149917824:12345-0@lo:502: Request processed in 299us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.645350:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789607293.645465:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9542037 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149917824:0@lo:502: 00000040:00080000:1.0:1789607293.645535:0:7259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789607293.645545:0:7259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789607293.647277:0:7276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789607293.647309:0:7276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000daad4971) 00000020:00000080:0.0:1789607293.647331:0:7276:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789607293.647434:0:7276:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc600d0a from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789607293.647438:0:7276:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bc600d0a from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789607293.647441:0:7276:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bc600d0a 3 00010000:00080000:0.0:1789607293.647470:0:7276:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000065005408@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607293.650599:0:7276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1789607293.650792:0:7276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789607293.650825:0:7276:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607293.650839:0:7276:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa26202d240fbd2bb 00000100:00080000:0.0:1789607293.650848:0:7276:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607293.650881:0:7276:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000065005408 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607293.650930:0:7276:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d31e0367 x1876539149917952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607293.650994:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d31e0367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539149917952:0@lo:38: 00000100:00100000:3.0:1789607293.651066:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607293.651105:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149917952 00000100:00100000:2.0:1789607293.651113:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149917952 00000100:00080000:0.0:1789607293.651125:0:7276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789607293.651143:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607293.651150:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081a0cb77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539149917952:12345-0@lo:38: 00010000:00080000:2.0:1789607293.651171:0:6469:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1789607293.651200:0:6469:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa26202d240fbd2c2 00000004:00100000:2.0:1789607293.651212:0:6469:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789607293.651238:0:6469:0:(import.c:65:import_set_state_nolock()) 00000000e39e47a4 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789607293.652463:0:6473:0:(import.c:65:import_set_state_nolock()) 00000000a7168ff1 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1789607293.652522:0:7276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789607293.652666:0:7277:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1789607293.652669:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc4f1628 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539149916416:12345-0@lo:38: Request processed in 18863us (19101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.652679:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1789607293.652711:0:7259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789607293.652735:0:7259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607293.652754:0:7259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607293.652755:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081a0cb77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3467:x1876539149917952:12345-0@lo:38: Request processed in 1604us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.652762:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789607293.652763:0:7259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000c9204f6c/0xa26202d240fbd2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789607293.652808:0:7259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789607293.652811:0:7259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607293.652812:0:7259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607293.652813:0:7259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607293.652814:0:7259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607293.652815:0:7259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607293.652816:0:7259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607293.652817:0:7259:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789607293.652818:0:7259:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789607293.652820:0:7259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607293.652821:0:7259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607293.652823:0:7259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789607293.652826:0:7259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789607293.652827:0:7259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607293.652828:0:7259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607293.652829:0:7259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607293.652830:0:7259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607293.652831:0:7259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607293.652832:0:7259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607293.652833:0:7259:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789607293.652834:0:7259:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789607293.652835:0:7259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607293.652836:0:7259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607293.652853:0:7259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789607293.652882:0:7259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149918080:0@lo:253: 00000100:00100000:1.0:1789607293.652920:0:7259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.652949:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918080 00000100:00100000:1.0:1789607293.652955:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918080 00000100:00100000:1.0:1789607293.652999:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607293.653005:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000463f4adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:7259:x1876539149918080:12345-0@lo:253: 20000000:01000000:1.0:1789607293.653034:0:6462:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789607293.653046:0:6462:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789607293.653455:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d31e0367 x1876539149917952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607293.653466:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607293.653474:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789607293.653480:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789607293.653484:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607293.653486:0:3467:0:(import.c:65:import_set_state_nolock()) 0000000065005408 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607293.653492:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d31e0367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539149917952:0@lo:38: 00000100:00100000:3.0:1789607293.653503:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607293.653507:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789607293.653511:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789607293.653515:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607293.653522:0:3467:0:(import.c:65:import_set_state_nolock()) 00000000e604ec9e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607293.653541:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004854721b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539149916416:0@lo:38: 00000100:00100000:1.0:1789607293.653667:0:7259:0:(client.c:2716:ptlrpc_set_wait()) set 00000000555c9d92 going to sleep for 11 seconds 00000100:00100000:1.0:1789607293.653843:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b81e9aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149918208:0@lo:41: 00000100:00100000:1.0:1789607293.653906:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.653956:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918208 00000100:00100000:1.0:1789607293.653961:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918208 00000100:00100000:1.0:1789607293.653987:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607293.653992:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000869bd733 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3468:x1876539149918208:12345-0@lo:41: 00000004:00000024:1.0:1789607293.654020:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607293.654059:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000869bd733 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3468:x1876539149918208:12345-0@lo:41: Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.654066:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607293.654096:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b81e9aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149918208:0@lo:41: 00000001:00100000:2.0:1789607293.673274:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789607293.673456:0:6462:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607293.673502:0:6462:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789607293.675184:0:6484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789607293.675192:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789607293.675211:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675230:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675236:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd283 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675253:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675293:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd283 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675305:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd283 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.675317:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe12e85f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149918336:0@lo:104: 00000100:00100000:3.0:1789607293.675396:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607293.675438:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675445:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.675452:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149918464:0@lo:104: 00000100:00100000:3.0:1789607293.675488:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.675504:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5c71de4 going to sleep for 11 seconds 00000100:00100000:3.0:1789607293.675531:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918336 00000100:00100000:3.0:1789607293.675538:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918336 00000100:00100000:3.0:1789607293.675571:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918464 00000100:00100000:3.0:1789607293.675573:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918464 00000100:00100000:3.0:1789607293.675586:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607293.675593:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a102bcc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6484:x1876539149918336:12345-0@lo:104: 00010000:00010000:3.0:1789607293.675606:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675652:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607293.675658:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a102bcc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6484:x1876539149918336:12345-0@lo:104: Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.675664:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607293.675680:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607293.675685:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b6fa7c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149918464:12345-0@lo:104: 00010000:00010000:3.0:1789607293.675691:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675719:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607293.675723:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b6fa7c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149918464:12345-0@lo:104: Request processed in 39us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.675728:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789607293.675743:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607293.675747:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675754:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000071b9e9c already unused, calling callback (00000000b1689aef) 10000000:00010000:3.0:1789607293.675763:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675771:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607293.675776:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.675782:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607293.675808:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675815:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607293.675831:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675838:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd28a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675850:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607293.675853:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675857:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000722cad5 already unused, calling callback (00000000b1689aef) 10000000:00010000:3.0:1789607293.675878:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675886:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607293.675902:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607293.675906:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607293.675918:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675924:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607293.675942:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675948:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 000000000722cad5/0xa26202d240fbd1e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1e9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607293.675961:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607293.675962:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607293.675964:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607293.675969:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607293.675981:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607293.675991:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000672c49b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149918720:0@lo:103: 00000100:00100000:3.0:1789607293.676018:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.676054:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe12e85f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149918336:0@lo:104: 00000100:00100000:3.0:1789607293.676061:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149918464:0@lo:104: 00010000:00010000:3.0:1789607293.676077:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607293.676319:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd5e2716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149918592:0@lo:103: 00000100:00100000:1.0:1789607293.676409:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.676460:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918720 00000100:00100000:1.0:1789607293.676465:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918720 00010000:00010000:1.0:1789607293.676485:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 16 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607293.676506:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918592 00000100:00100000:1.0:1789607293.676508:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918592 00010000:00010000:1.0:1789607293.676520:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd283 expref: 17 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607293.676575:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607293.676588:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fcaf63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+17:3471:x1876539149918720:12345-0@lo:103: 00010000:00010000:1.0:1789607293.676599:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607293.676604:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 17 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676612:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 17 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676623:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a7a0107/0xa26202d240fbd1e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd1e2 expref: 17 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676636:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607293.676665:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fcaf63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+16:3471:x1876539149918720:12345-0@lo:103: Request processed in 77us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.676671:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607293.676685:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607293.676690:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fab724e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+15:3469:x1876539149918592:12345-0@lo:103: 00010000:00010000:1.0:1789607293.676697:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607293.676700:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd283 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676708:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd283 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676717:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000001a0a637/0xa26202d240fbd28a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd283 expref: 15 pid: 6462 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676726:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676743:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789607293.676754:0:6454:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003448739s 00010000:00010000:1.0:1789607293.676758:0:6454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676764:0:6454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676769:0:6454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676775:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676780:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022c343fe already unused, calling callback (0000000051141bff) 00010000:00010000:1.0:1789607293.676782:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676788:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676800:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.676808:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607293.676834:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fab724e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+14:3469:x1876539149918592:12345-0@lo:103: Request processed in 145us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.676840:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607293.677137:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd5e2716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149918592:0@lo:103: 00000100:00100000:1.0:1789607293.677161:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000672c49b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149918720:0@lo:103: 00010000:00010000:1.0:1789607293.677176:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.677182:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607293.677187:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607293.682657:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000463f4adb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+13:7259:x1876539149918080:12345-0@lo:253: Request processed in 29645us (29730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607293.682685:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607293.682766:0:7259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:7259:1876539149918080:0@lo:253: 10000000:01000000:1.0:1789607293.682782:0:7259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789607293.682784:0:7259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789607293.682786:0:7259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607293.682787:0:7259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607293.682789:0:7259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607293.682790:0:7259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607293.682791:0:7259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607293.682792:0:7259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607293.682793:0:7259:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789607293.682794:0:7259:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789607293.682795:0:7259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607293.682797:0:7259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789607293.682809:0:7259:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789607293.694483:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607293.694806:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607293.695039:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607293.695226:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607293.695442:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607293.695613:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607293.701141:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607293.701638:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607293.701841:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607293.702264:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607293.702470:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607293.702643:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:1.0:1789607293.704804:0:7259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1789607293.705097:0:7282:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789607293.705150:0:7282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7282:1876539149918848:0@lo:700: 00000100:00100000:1.0:1789607293.705321:0:7282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.705525:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918848 00000100:00100000:1.0:1789607293.705532:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918848 00000100:00100000:1.0:1789607293.705569:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607293.705577:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075413aa6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7282:x1876539149918848:12345-0@lo:700: 00000100:00100000:1.0:1789607293.706058:0:7282:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5b89e84 going to sleep for 11 seconds 00000040:01000000:2.0:1789607293.706135:0:7259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:3.0:1789607293.706675:0:7281:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789607293.706679:0:7281:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789607293.710508:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b786bd6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149918976:0@lo:1000: 00000100:00100000:0.0:1789607293.710581:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607293.710629:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d12ea34b going to sleep for 11 seconds 00000040:01000000:3.0:1789607293.711135:0:7259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789607293.711266:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789607293.711676:0:7259:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789607293.711684:0:7259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789607293.711812:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607293.712750:0:7259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789607293.713284:0:7259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789607293.713313:0:7259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789607293.713574:0:7259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789607293.713748:0:7259:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000100:00100000:1.0:1789607293.714671:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149918976 00000100:00100000:1.0:1789607293.714682:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149918976 00000100:00100000:1.0:1789607293.714737:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607293.714747:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc407c8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149918976:12345-0@lo:1000: 00000100:00100000:1.0:1789607293.714895:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc407c8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149918976:12345-0@lo:1000: Request processed in 150us (4314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.714903:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607293.714950:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b786bd6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149918976:0@lo:1000: 00000040:01000000:1.0:1789607293.714985:0:7283:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789607293.715022:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919104:0@lo:700: 00000100:00100000:1.0:1789607293.715056:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.715094:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149919104 00000100:00100000:1.0:1789607293.715098:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149919104 00000100:00100000:1.0:1789607293.715120:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607293.715126:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000535b0f49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919104:12345-0@lo:700: 00000100:00100000:1.0:1789607293.715161:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000535b0f49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919104:12345-0@lo:700: Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.715167:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607293.715183:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d977a1c going to sleep for 11 seconds 00000100:00100000:1.0:1789607293.715201:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919104:0@lo:700: 00000100:00100000:1.0:1789607293.715249:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7283:1876539149919232:0@lo:900: 00000100:00100000:1.0:1789607293.715272:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.715299:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149919232 00000100:00100000:1.0:1789607293.715302:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149919232 00000100:00100000:1.0:1789607293.715325:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607293.715330:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7dca5bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7283:x1876539149919232:12345-0@lo:900: 00000100:00100000:1.0:1789607293.715382:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7dca5bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7283:x1876539149919232:12345-0@lo:900: Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.715387:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607293.715404:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d977a1c going to sleep for 11 seconds 00010000:00080000:1.0:1789607293.715416:0:7283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004d7c191e x1876539149919232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607309 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607293.715426:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7283:1876539149919232:0@lo:900: 00000100:00100000:1.0:1789607293.715490:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919360:0@lo:1000: 00000100:00100000:1.0:1789607293.715514:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.715534:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149919360 00000100:00100000:1.0:1789607293.715537:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149919360 00000100:00100000:1.0:1789607293.715553:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607293.715557:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000575869f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919360:12345-0@lo:1000: 00000100:00100000:1.0:1789607293.715610:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000575869f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919360:12345-0@lo:1000: Request processed in 52us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607293.715616:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607293.715632:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2a58259 going to sleep for 11 seconds 00000100:00100000:1.0:1789607293.715642:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919360:0@lo:1000: 00000004:00080000:1.0:1789607293.715673:0:7283:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000005d977a1c with version 0 00000020:00100000:1.0:1789607293.715691:0:7283:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789607293.715696:0:7283:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004d7c191e x1876539149919616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607293.715706:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919616:0@lo:1000: 00000100:00100000:1.0:1789607293.715729:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607293.715747:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149919616 00000100:00100000:1.0:1789607293.715750:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149919616 00000100:00100000:1.0:1789607293.715765:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607293.715770:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000517c2b18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919616:12345-0@lo:1000: 00000100:00100000:1.0:1789607293.716587:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 00000000016f099d going to sleep for 11 seconds 00100000:10000000:3.0:1789607293.719237:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789607293.719614:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789607293.719756:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789607293.719917:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789607293.720049:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789607293.720249:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789607293.720684:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789607293.720825:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789607293.721005:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789607293.721141:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789607293.721276:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789607293.721526:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789607293.721680:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789607293.721831:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789607293.722127:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789607293.722269:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789607293.723807:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789607293.723993:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789607293.724143:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789607293.724278:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789607293.724454:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789607293.724581:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789607293.724713:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789607293.724929:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789607293.725064:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789607293.725197:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789607293.725329:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789607293.725480:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789607293.725646:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789607293.725793:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789607293.725957:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789607293.726098:0:7259:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789607293.726287:0:7259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 40000000:02000000:2.0:1789607293.788215:0:6475:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1789607293.793320:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075413aa6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7282:x1876539149918848:12345-0@lo:700: Request processed in 87737us (87993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607293.793340:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789607293.798330:0:7282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000071480bf4 x1876539149918848/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789607309 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607293.798407:0:7282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7282:1876539149918848:0@lo:700: 40000000:02000000:1.0:1789607293.798422:0:7282:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:3.0:1789607293.834736:0:7259:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789607293.834778:0:7259:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa81b01caf988 00100000:10000000:3.0:1789607293.834789:0:7259:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789607293.838090:0:7259:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789607293.838131:0:7259:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789607293.838148:0:7259:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789607293.838167:0:7259:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000001:00080000:2.0:1789607293.866389:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789607293.871920:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000517c2b18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919616:12345-0@lo:1000: Request processed in 156142us (156183us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789607293.871940:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1789607293.872138:0:7283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789607293.872153:0:7283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789607293.872168:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d7c191e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919616:0@lo:1000: 00000100:00100000:3.0:1789607293.872249:0:7283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919744:0@lo:1000: 00000100:00100000:3.0:1789607293.872286:0:7283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.872331:0:7283:0:(client.c:2716:ptlrpc_set_wait()) set 000000001be9fe4d going to sleep for 11 seconds 00000100:00100000:0.0:1789607293.872467:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149919744 00000100:00100000:0.0:1789607293.872474:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149919744 00000100:00100000:0.0:1789607293.872559:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607293.872567:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe12e85f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919744:12345-0@lo:1000: 00000100:00100000:0.0:1789607293.872652:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe12e85f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7283:x1876539149919744:12345-0@lo:1000: Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607293.872659:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607293.872704:0:7283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7283:1876539149919744:0@lo:1000: 00000040:00080000:3.0:1789607293.872723:0:7283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789607293.872751:0:7283:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000016f099d with version 1 00000040:00080000:3.0:1789607293.874706:0:7283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789607293.874768:0:7283:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789607293.874888:0:7273:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000055759ca version 1 rpc_version 1 00000020:00100000:3.0:1789607293.874921:0:7273:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789607293.874929:0:7273:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003cc7f211 x1876539149920000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607293.874948:0:7273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7273:1876539149920000:0@lo:1000: 00000100:00100000:3.0:1789607293.875004:0:7273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607293.879924:0:7273:0:(client.c:2716:ptlrpc_set_wait()) set 000000001be9fe4d going to sleep for 11 seconds 00000100:00100000:2.0:1789607293.881404:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920000 00000100:00100000:2.0:1789607293.881417:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920000 00000100:00100000:2.0:1789607293.881472:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607293.881480:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001881da29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7273:x1876539149920000:12345-0@lo:1000: 00000001:00080000:2.0:1789607293.923909:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789607293.924032:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001881da29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7273:x1876539149920000:12345-0@lo:1000: Request processed in 42549us (49025us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789607293.924044:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789607293.924307:0:7273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789607293.924313:0:7273:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789607293.924329:0:7273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7273:1876539149920000:0@lo:1000: 00000040:00080000:1.0:1789607293.932558:0:7282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607293.959169:0:7282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789607293.959243:0:7282:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789607293.959248:0:7282:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1789607294.113980:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607295.142654:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607296.161995:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607297.187404:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607298.210080:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607298.630754:0:7525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789607298.787978:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7fcaf63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149920512:0@lo:400: 00000100:00100000:3.0:1789607298.788065:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607298.788144:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607298.788154:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149920128:0@lo:400: 00000100:00100000:3.0:1789607298.788188:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607298.788211:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000672c49b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149920256:0@lo:400: 00000100:00100000:2.0:1789607298.788353:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920512 00000100:00100000:2.0:1789607298.788362:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920512 00000100:00100000:2.0:1789607298.788413:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607298.788420:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9542037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149920512:12345-0@lo:400: 00000100:00100000:2.0:1789607298.788474:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9542037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149920512:12345-0@lo:400: Request processed in 54us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607298.788481:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607298.788504:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920128 00000100:00100000:2.0:1789607298.788507:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920128 00000100:00100000:2.0:1789607298.788530:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789607298.788536:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013d31d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+13:3470:x1876539149920128:12345-0@lo:400: 00000100:00100000:2.0:1789607298.788566:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013d31d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+13:3470:x1876539149920128:12345-0@lo:400: Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607298.788571:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789607298.788611:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149920128:0@lo:400: 00010000:00080000:2.0:1789607298.788628:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e7fcaf63 x1876539149920512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607298.788639:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7fcaf63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149920512:0@lo:400: 00000100:00100000:3.0:1789607298.788700:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607298.788730:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607298.788736:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd5e2716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149920384:0@lo:400: 00000100:00100000:3.0:1789607298.788761:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607298.789478:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920256 00000100:00100000:2.0:1789607298.789486:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920256 00000100:00100000:2.0:1789607298.789527:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607298.789534:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c76312 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149920256:12345-0@lo:400: 00000100:00100000:2.0:1789607298.789588:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c76312 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149920256:12345-0@lo:400: Request processed in 55us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607298.789594:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789607298.789626:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000672c49b4 x1876539149920256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607298.789637:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000672c49b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149920256:0@lo:400: 00000100:00100000:1.0:1789607298.791889:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920384 00000100:00100000:1.0:1789607298.791903:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920384 00000100:00100000:1.0:1789607298.791960:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607298.791969:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ef8b8eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149920384:12345-0@lo:400: 00000100:00100000:1.0:1789607298.792064:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ef8b8eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149920384:12345-0@lo:400: Request processed in 97us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607298.792072:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607298.792316:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd5e2716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149920384:0@lo:400: 00000100:00100000:2.0:1789607298.797085:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607298.797109:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149920640:0@lo:41: 00000100:00100000:2.0:1789607298.797174:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607298.797284:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920640 00000100:00100000:1.0:1789607298.797292:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920640 00000100:00100000:1.0:1789607298.797353:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607298.797360:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a3e5164 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149920640:12345-0@lo:41: 00000004:00000024:1.0:1789607298.797399:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607298.797449:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a3e5164 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149920640:12345-0@lo:41: Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607298.797456:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607298.797497:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149920640:0@lo:41: 00010000:00010000:2.0:1789607299.238110:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607300.258470:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607301.282801:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607302.306891:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607302.883461:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789607302.883485:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78f05a9800 from 4 10000000:01000000:2.0:1789607302.883488:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607302.883528:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.883538:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.883548:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607302.883570:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f85b71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149920768:0@lo:101: 00000100:00100000:2.0:1789607302.883636:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607302.883694:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f7e6d8f going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.886962:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920768 00000100:00100000:3.0:1789607302.886977:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920768 00000100:00100000:3.0:1789607302.887047:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607302.887055:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d784356e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+13:6466:x1876539149920768:12345-0@lo:101: 00010000:00010000:3.0:1789607302.887071:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607302.887087:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd2d0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887111:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 14 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887120:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022c343fe/0xa26202d240fbd2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 14 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887127:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022c343fe, rc 0) 00000100:00100000:3.0:1789607302.887211:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d784356e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+14:6466:x1876539149920768:12345-0@lo:101: Request processed in 156us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.887217:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607302.887272:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f85b71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149920768:0@lo:101: 00010000:00010000:3.0:1789607302.887316:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887324:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607302.887384:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149920896:0@lo:256: 00000100:00100000:3.0:1789607302.887421:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.887442:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa321da1 going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.887457:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149920896 00000100:00100000:3.0:1789607302.887460:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149920896 00000100:00100000:3.0:1789607302.887484:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607302.887489:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006eb032bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:6466:x1876539149920896:12345-0@lo:256: 20000000:01000000:3.0:1789607302.887502:0:6463:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607302.887515:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607302.887518:0:6463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789607302.887589:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006eb032bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:6466:x1876539149920896:12345-0@lo:256: Request processed in 100us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.887596:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607302.887625:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149920896:0@lo:256: 10000000:01000000:3.0:1789607302.887663:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607302.887669:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887676:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000006ed0086b/0xa26202d240fbd2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607302.887698:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789607302.887705:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c75d7000 from 21 10000000:01000000:3.0:1789607302.887708:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607302.887727:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887732:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887739:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607302.887748:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921024:0@lo:101: 00000100:00100000:3.0:1789607302.887771:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.887784:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa321da1 going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.887795:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921024 00000100:00100000:3.0:1789607302.887798:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921024 00000100:00100000:3.0:1789607302.887816:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607302.887821:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d6480d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:6466:x1876539149921024:12345-0@lo:101: 00010000:00010000:3.0:1789607302.887827:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607302.887833:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c86c23c7/0xa26202d240fbd2e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd2de expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887847:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c86c23c7/0xa26202d240fbd2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd2de expref: 15 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887855:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c86c23c7/0xa26202d240fbd2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2de expref: 15 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887881:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c86c23c7, rc 0) 00000100:00100000:3.0:1789607302.887906:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d6480d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149921024:12345-0@lo:101: Request processed in 85us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.887918:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607302.887947:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921024:0@lo:101: 00010000:00010000:3.0:1789607302.887955:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607302.887962:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607302.888000:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921152:0@lo:501: 00000100:00100000:3.0:1789607302.888022:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.888035:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa321da1 going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.888045:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921152 00000100:00100000:3.0:1789607302.888048:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921152 00000100:00100000:3.0:1789607302.888069:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607302.888074:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000096f44c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149921152:12345-0@lo:501: 00000100:00100000:3.0:1789607302.888392:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000096f44c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149921152:12345-0@lo:501: Request processed in 317us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.888398:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607302.888426:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921152:0@lo:501: 00000100:00100000:3.0:1789607302.888459:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921280:0@lo:503: 00000100:00100000:3.0:1789607302.888491:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.888511:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa321da1 going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.888521:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921280 00000100:00100000:3.0:1789607302.888524:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921280 00000100:00100000:3.0:1789607302.888543:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607302.888548:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf7ac207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149921280:12345-0@lo:503: 00000100:00100000:3.0:1789607302.888798:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf7ac207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149921280:12345-0@lo:503: Request processed in 249us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.888804:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607302.888836:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921280:0@lo:503: 00000100:00100000:3.0:1789607302.888985:0:7703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7703:1876539149921408:0@lo:502: 00000100:00100000:3.0:1789607302.889015:0:7703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.889034:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921408 00000100:00100000:3.0:1789607302.889037:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921408 00000100:00100000:3.0:1789607302.889060:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607302.889065:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001289cb9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:7703:x1876539149921408:12345-0@lo:502: 00000100:00100000:1.0:1789607302.891990:0:7703:0:(client.c:2716:ptlrpc_set_wait()) set 00000000203763f8 going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.894510:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001289cb9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:7703:x1876539149921408:12345-0@lo:502: Request processed in 5439us (5488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.894526:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789607302.894587:0:7703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb9cde16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7703:1876539149921408:0@lo:502: 00000100:00100000:1.0:1789607302.894653:0:7703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7703:1876539149921536:0@lo:502: 00000100:00100000:1.0:1789607302.894691:0:7703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.894729:0:7703:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f21524f9 going to sleep for 11 seconds 00000100:00100000:2.0:1789607302.894772:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921536 00000100:00100000:2.0:1789607302.894778:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921536 00000100:00100000:2.0:1789607302.894813:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607302.894820:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017fe5bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:7703:x1876539149921536:12345-0@lo:502: 00000100:00100000:2.0:1789607302.895000:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017fe5bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:7703:x1876539149921536:12345-0@lo:502: Request processed in 180us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607302.895007:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789607302.895076:0:7703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7703:1876539149921536:0@lo:502: 00000040:00080000:1.0:1789607302.895092:0:7703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789607302.895356:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789607302.895372:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607302.895380:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.895390:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000003ad80e5a/0xa26202d240fbd2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607302.895399:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789607302.895401:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c75d7000 from 4 10000000:01000000:2.0:1789607302.895403:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607302.895426:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.895433:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.895440:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607302.895461:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000870f482f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921664:0@lo:101: 00000100:00100000:2.0:1789607302.895595:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607302.895654:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b4a9989 going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.897701:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921664 00000100:00100000:1.0:1789607302.897715:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921664 00000100:00100000:1.0:1789607302.897770:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789607302.897778:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000033549b29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149921664:12345-0@lo:101: 00010000:00010000:1.0:1789607302.897794:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607302.897811:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000912eea45/0xa26202d240fbd2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd2ec expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.897835:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000912eea45/0xa26202d240fbd2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 16 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.897844:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000912eea45/0xa26202d240fbd2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 16 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.897882:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000912eea45, rc 0) 00000100:00100000:1.0:1789607302.897951:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000033549b29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149921664:12345-0@lo:101: Request processed in 174us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.897957:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789607302.897993:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000870f482f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921664:0@lo:101: 00010000:00010000:1.0:1789607302.898008:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898016:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607302.898073:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921792:0@lo:256: 00000100:00100000:1.0:1789607302.898111:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.898134:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f21524f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.898152:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921792 00000100:00100000:1.0:1789607302.898155:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921792 00000100:00100000:1.0:1789607302.898172:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789607302.898177:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7b4ccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149921792:12345-0@lo:256: 20000000:01000000:1.0:1789607302.898190:0:6463:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789607302.898205:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789607302.898208:0:6463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789607302.898292:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7b4ccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149921792:12345-0@lo:256: Request processed in 114us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.898310:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789607302.898332:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921792:0@lo:256: 10000000:01000000:1.0:1789607302.898368:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607302.898378:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898385:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000008467eb2c/0xa26202d240fbd2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607302.898393:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789607302.898396:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789607302.898399:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789607302.898415:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898421:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898429:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607302.898439:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921920:0@lo:101: 00000100:00100000:1.0:1789607302.898463:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.898727:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f21524f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.898746:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149921920 00000100:00100000:1.0:1789607302.898750:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149921920 00000100:00100000:1.0:1789607302.898767:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607302.898772:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3902331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149921920:12345-0@lo:101: 00010000:00010000:1.0:1789607302.898779:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607302.898788:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd2fa expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898802:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898820:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fcc8fbd/0xa26202d240fbd301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898825:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fcc8fbd, rc 0) 00000100:00100000:1.0:1789607302.898856:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3902331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149921920:12345-0@lo:101: Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.898887:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607302.898910:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149921920:0@lo:101: 00010000:00010000:1.0:1789607302.898919:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607302.898926:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607302.898966:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149922048:0@lo:501: 00000100:00100000:1.0:1789607302.898988:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.898997:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f21524f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.899011:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922048 00000100:00100000:1.0:1789607302.899014:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922048 00000100:00100000:1.0:1789607302.899028:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607302.899034:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d8318fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149922048:12345-0@lo:501: 00000100:00100000:1.0:1789607302.899255:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d8318fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149922048:12345-0@lo:501: Request processed in 222us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.899262:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607302.899280:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149922048:0@lo:501: 00000100:00100000:1.0:1789607302.899317:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149922176:0@lo:503: 00000100:00100000:1.0:1789607302.899357:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.899367:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f21524f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.899382:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922176 00000100:00100000:1.0:1789607302.899386:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922176 00000100:00100000:1.0:1789607302.899402:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607302.899407:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071813d93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149922176:12345-0@lo:503: 00000100:00100000:0.0:1789607302.903337:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071813d93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149922176:12345-0@lo:503: Request processed in 3924us (3975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607302.903352:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607302.904464:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071480bf4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149922176:0@lo:503: 00000100:00100000:2.0:1789607302.905055:0:7705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa7d017a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7705:1876539149922304:0@lo:502: 00000100:00100000:2.0:1789607302.905119:0:7705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607302.905608:0:7705:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c347361e going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.905669:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922304 00000100:00100000:3.0:1789607302.905677:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922304 00000100:00100000:3.0:1789607302.905725:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789607302.905734:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afecd95a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:7705:x1876539149922304:12345-0@lo:502: 00000100:00100000:3.0:1789607302.906052:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afecd95a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:7705:x1876539149922304:12345-0@lo:502: Request processed in 318us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607302.906060:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789607302.906327:0:7705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa7d017a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7705:1876539149922304:0@lo:502: 00000020:01000000:1.0:1789607302.906354:0:7705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607302.906365:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607302.906367:0:7705:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789607302.906373:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789607302.906376:0:7705:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:00000080:1.0:1789607302.906398:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607302.906412:0:7705:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000869d8113) 00000020:00000080:1.0:1789607302.906430:0:7705:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789607302.906435:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789607302.906574:0:7705:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789607302.906579:0:7705:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789607302.906585:0:7705:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd30f 00010000:00080000:1.0:1789607302.906611:0:7705:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000efbc5579@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607302.916493:0:7705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1789607302.924431:0:7705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607302.924446:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789607302.925656:0:7705:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789607302.925683:0:7705:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd316 00000100:00080000:3.0:1789607302.925693:0:7705:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607302.925702:0:7705:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000efbc5579 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607302.925742:0:7705:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a536df58 x1876539149922432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607302.927254:0:7705:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789607302.927323:0:7705:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1789607302.927457:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539149922432:0@lo:38: 00000100:00100000:1.0:1789607302.927527:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607302.928153:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149922560:0@lo:400: 00000100:00100000:0.0:1789607302.928198:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607302.928230:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607302.928236:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060b212fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149922688:0@lo:400: 00000100:00100000:0.0:1789607302.928265:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.936286:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149922816:0@lo:400: 00000100:00100000:1.0:1789607302.936377:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.936450:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922432 00000100:00100000:1.0:1789607302.936516:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922432 00000100:00100000:1.0:1789607302.936544:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922688 00000100:00100000:1.0:1789607302.936548:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922688 00000100:00100000:1.0:1789607302.936576:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607302.936581:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071480bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539149922432:12345-0@lo:38: 00010000:00080000:1.0:1789607302.936607:0:6473:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789607302.936641:0:6473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd31d 00000004:00100000:1.0:1789607302.936654:0:6473:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789607302.936660:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789607302.937059:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922560 00000100:00100000:1.0:1789607302.937065:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922560 00000100:00100000:2.0:1789607302.937074:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922816 00000100:00100000:2.0:1789607302.937081:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922816 00000100:00100000:1.0:1789607302.937100:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607302.937109:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083459891 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149922560:12345-0@lo:400: 00000100:00100000:2.0:1789607302.937113:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789607302.937121:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789607302.937138:0:6468:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789607302.937153:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607302.937161:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ade6be6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149922816:12345-0@lo:400: 00000100:00100000:1.0:1789607302.937173:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083459891 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149922560:12345-0@lo:400: Request processed in 66us (8974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.937180:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789607302.937224:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cd4d4eb3 x1876539149922560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607302.937238:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149922560:0@lo:400: 00000100:00080000:3.0:1789607302.937656:0:7708:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000cd4d4eb3 x1876539149922944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607302.937666:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daa843da going to sleep for 0 seconds 00000020:01000000:0.0:1789607302.937807:0:7705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607302.937814:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607302.937816:0:7705:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789607302.937822:0:7705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607302.937825:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607302.937826:0:7705:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607302.937830:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607302.937831:0:7705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789607302.937853:0:7705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a023deda pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7705:1876539149923072:0@lo:502: 00000100:00100000:2.0:1789607302.944642:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ade6be6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149922816:12345-0@lo:400: Request processed in 7474us (8258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607302.944658:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789607302.944748:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b80ae182 x1876539149922816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607302.944773:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b80ae182 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149922816:0@lo:400: 00000100:00100000:0.0:1789607302.949725:0:7705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607302.949837:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923072 00000100:00100000:0.0:1789607302.949846:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923072 00000100:00100000:0.0:1789607302.949922:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789607302.949933:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf40ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:7705:x1876539149923072:12345-0@lo:502: 00000100:00100000:0.0:1789607302.950174:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf40ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:7705:x1876539149923072:12345-0@lo:502: Request processed in 244us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607302.950182:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789607302.950249:0:7705:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019856cff going to sleep for 11 seconds 00000100:00100000:0.0:1789607302.950272:0:7705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a023deda pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:7705:1876539149923072:0@lo:502: 00000020:01000000:0.0:1789607302.950317:0:7705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607302.950324:0:7705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607302.950326:0:7705:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789607302.950338:0:7705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789607302.956555:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789607302.956588:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789607302.956598:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607302.956609:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000002a49b9ca/0xa26202d240fbd2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607302.956619:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789607302.956621:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78e9ee99c0 from 1 10000000:01000000:0.0:1789607302.956623:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789607302.956656:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607302.956664:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607302.956675:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607302.956695:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a023deda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149923200:0@lo:101: 00000100:00100000:0.0:1789607302.956758:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607302.956807:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019856cff going to sleep for 11 seconds 00000100:00100000:2.0:1789607302.959433:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923200 00000100:00100000:2.0:1789607302.959445:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923200 00000100:00100000:2.0:1789607302.959493:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607302.959501:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015dc8d4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149923200:12345-0@lo:101: 00010000:00010000:2.0:1789607302.959515:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607302.959531:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008e8d7ea/0xa26202d240fbd32b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd324 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.959557:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008e8d7ea/0xa26202d240fbd32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd324 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.959567:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008e8d7ea/0xa26202d240fbd32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd324 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.960549:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008e8d7ea, rc 0) 00000100:00100000:2.0:1789607302.960648:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015dc8d4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149923200:12345-0@lo:101: Request processed in 1147us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607302.960656:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607302.961195:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a023deda pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149923200:0@lo:101: 00010000:00010000:2.0:1789607302.961226:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.961238:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607302.963531:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cc8f81b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149923328:0@lo:501: 00000100:00100000:2.0:1789607302.963598:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607302.963637:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000762e33e3 going to sleep for 11 seconds 00000100:00100000:2.0:1789607302.964597:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923328 00000100:00100000:2.0:1789607302.964608:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923328 00000100:00100000:2.0:1789607302.964655:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607302.964663:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d0e4c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149923328:12345-0@lo:501: 00000100:00100000:2.0:1789607302.964891:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d0e4c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149923328:12345-0@lo:501: Request processed in 228us (1293us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607302.964900:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607302.964946:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cc8f81b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149923328:0@lo:501: 10000000:01000000:2.0:1789607302.964979:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607302.964987:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607302.964996:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000f2e73b18/0xa26202d240fbd324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607302.993224:0:6473:0:(import.c:65:import_set_state_nolock()) 00000000d79c0797 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607302.993336:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071480bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539149922432:12345-0@lo:38: Request processed in 56752us (65808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607302.993348:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607302.993379:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607302.993389:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b786bd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149922688:12345-0@lo:400: 00000100:00100000:0.0:1789607302.993448:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b786bd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149922688:12345-0@lo:400: Request processed in 64us (65184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607302.993455:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607302.993500:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060b212fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149922688:0@lo:400: 00000100:00100000:3.0:1789607302.993745:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607302.993753:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789607302.993761:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789607302.993918:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789607302.993922:0:3467:0:(import.c:65:import_set_state_nolock()) 00000000efbc5579 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789607302.993936:0:3467:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000daa843da): req@00000000cd4d4eb3 x1876539149922944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607302.993950:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a536df58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539149922432:0@lo:38: 00000100:00100000:3.0:1789607302.994021:0:7708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.994056:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daa843da going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.994113:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149922944 00000100:00100000:1.0:1789607302.994121:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149922944 00000100:00100000:1.0:1789607302.994159:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607302.994165:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a536df58 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149922944:12345-0@lo:1000: 00000100:00100000:1.0:1789607302.994240:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a536df58 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149922944:12345-0@lo:1000: Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.994248:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607302.994460:0:7708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149922944:0@lo:1000: 00000040:01000000:3.0:1789607302.994596:0:7708:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789607302.994632:0:7708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923456:0@lo:1000: 00000100:00100000:3.0:1789607302.994661:0:7708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.994682:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daa843da going to sleep for 11 seconds 00000100:00100000:1.0:1789607302.994720:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923456 00000100:00100000:1.0:1789607302.994730:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923456 00000100:00100000:1.0:1789607302.994749:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607302.994756:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9cde16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149923456:12345-0@lo:1000: 00000100:00100000:1.0:1789607302.994974:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9cde16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149923456:12345-0@lo:1000: Request processed in 218us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.994980:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607302.995042:0:7708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923456:0@lo:1000: 00000100:00100000:3.0:1789607302.995078:0:7708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923584:0@lo:700: 00000100:00100000:3.0:1789607302.995101:0:7708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607302.995127:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019c9c6b8 going to sleep for 11 seconds 00000100:00100000:2.0:1789607302.995182:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923584 00000100:00100000:2.0:1789607302.995187:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923584 00000100:00100000:2.0:1789607302.995219:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607302.995224:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5e2716 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149923584:12345-0@lo:700: 00000100:00100000:3.0:1789607302.995384:0:7708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923584:0@lo:700: 00000100:00100000:2.0:1789607302.995543:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5e2716 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149923584:12345-0@lo:700: Request processed in 318us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607302.995551:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607302.995718:0:7708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923712:0@lo:1000: 00000100:00100000:3.0:1789607302.995749:0:7708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.995952:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923712 00000100:00100000:1.0:1789607302.995957:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923712 00000100:00100000:1.0:1789607302.995977:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607302.995982:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000672c49b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149923712:12345-0@lo:1000: 00000100:00100000:1.0:1789607302.996102:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000672c49b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7708:x1876539149923712:12345-0@lo:1000: Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607302.996109:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607302.996150:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c77a9a7 going to sleep for 11 seconds 00000100:00100000:3.0:1789607302.996163:0:7708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923712:0@lo:1000: 00000004:00080000:3.0:1789607302.996202:0:7708:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000019c9c6b8 with version 0 00000020:00100000:3.0:1789607302.996217:0:7708:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789607302.996223:0:7708:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cd4d4eb3 x1876539149923968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607302.996236:0:7708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923968:0@lo:1000: 00000100:00100000:3.0:1789607302.996263:0:7708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607302.996379:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607302.996388:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cc8f81b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149924096:0@lo:41: 00000100:00100000:3.0:1789607302.996533:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2c013cd going to sleep for 11 seconds 00000100:00100000:2.0:1789607302.996671:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607302.996754:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149923968 00000100:00100000:1.0:1789607302.996760:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149923968 00000100:00100000:0.0:1789607302.996977:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924096 00000100:00100000:0.0:1789607302.996982:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924096 00000100:00100000:1.0:1789607302.997678:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607302.997686:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fcaf63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7708:x1876539149923968:12345-0@lo:1000: 00000100:00100000:0.0:1789607303.068118:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fcaf63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7708:x1876539149923968:12345-0@lo:1000: Request processed in 70425us (71847us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789607303.068135:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607303.068166:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607303.068177:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa7d017a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3470:x1876539149924096:12345-0@lo:41: 00000004:00000024:0.0:1789607303.068215:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607303.068389:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa7d017a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3470:x1876539149924096:12345-0@lo:41: Request processed in 215us (71718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607303.068397:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607303.068453:0:7708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149923968:0@lo:1000: 00000100:00100000:0.0:1789607303.068536:0:7708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1fad881 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149924224:0@lo:1000: 00000100:00100000:0.0:1789607303.069042:0:7708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607303.069080:0:7708:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c35b9471 going to sleep for 11 seconds 00000100:00100000:0.0:1789607303.069099:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924224 00000100:00100000:0.0:1789607303.069106:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924224 00000100:00100000:0.0:1789607303.069141:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607303.069147:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a84a5e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7708:x1876539149924224:12345-0@lo:1000: 00000100:00100000:0.0:1789607303.069225:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a84a5e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7708:x1876539149924224:12345-0@lo:1000: Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607303.069232:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000001:00080000:1.0:1789607303.070220:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789607303.070235:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789607303.071025:0:7708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1fad881 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7708:1876539149924224:0@lo:1000: 00000040:00080000:0.0:1789607303.071064:0:7708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789607303.071101:0:7708:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000000845e7c1 with version 1 00000004:00080000:1.0:1789607303.071138:0:7706:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000047bbc8c8 version 1 rpc_version 1 00000020:00100000:1.0:1789607303.071167:0:7706:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789607303.071174:0:7706:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000906dd3a8 x1876539149924480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607303.071195:0:7706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000906dd3a8 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7706:1876539149924480:0@lo:1000: 00000100:00100000:1.0:1789607303.071248:0:7706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607303.071290:0:7706:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1dff8b8 going to sleep for 11 seconds 00000100:00100000:1.0:1789607303.071315:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924480 00000100:00100000:1.0:1789607303.071327:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924480 00000100:00100000:1.0:1789607303.071363:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607303.071369:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f040572 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7706:x1876539149924480:12345-0@lo:1000: 00000100:00100000:2.0:1789607303.071828:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cc8f81b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149924096:0@lo:41: 00000040:00080000:0.0:1789607303.075478:0:7708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789607303.075552:0:7708:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1789607303.075557:0:7708:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789607303.129184:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f040572 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7706:x1876539149924480:12345-0@lo:1000: Request processed in 57807us (57929us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789607303.129200:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000001:00080000:0.0:1789607303.129206:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789607303.129355:0:7706:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000004:00080000:3.0:1789607303.129361:0:7706:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789607303.129380:0:7706:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@00000000906dd3a8 x1876539149924480/t4294967298(4294967298) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 1789607319 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607303.129403:0:7706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000906dd3a8 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7706:1876539149924480:0@lo:1000: 00000020:00000080:2.0:1789607303.298276:0:7734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3625c1b0 20000000:00000080:2.0:1789607303.298302:0:7734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d78f6188000 uarg=0000000000000000 20000000:01000000:2.0:1789607303.298335:0:7734:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789607303.298341:0:7734:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789607303.298345:0:7734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789607303.298601:0:7734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789607303.298611:0:7734:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789607303.307550:0:7734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607303.308249:0:7734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789607303.308320:0:7734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789607303.308386:0:7734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789607303.308402:0:7734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789607303.308417:0:7734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.308434:0:7734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.308450:0:7734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd298 expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.308455:0:7734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.308489:0:7734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd298 expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.308502:0:7734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd298 expref: 17 pid: 6462 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607303.308515:0:7734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7734:1876539149924608:0@lo:104: 00000100:00100000:3.0:1789607303.308654:0:7734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607303.308712:0:7734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.308719:0:7734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607303.308727:0:7734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7734:1876539149924736:0@lo:104: 00000100:00100000:3.0:1789607303.308746:0:7734:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019c9c6b8 going to sleep for 11 seconds 00000100:00100000:1.0:1789607303.308918:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789607303.308938:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607303.308976:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924608 00000100:00100000:1.0:1789607303.308984:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924608 00000100:00100000:1.0:1789607303.309029:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924736 00000100:00100000:1.0:1789607303.309032:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924736 00000100:00100000:1.0:1789607303.309046:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607303.309051:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f420624f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:7734:x1876539149924608:12345-0@lo:104: 00010000:00010000:1.0:1789607303.309062:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309126:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607303.309131:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f420624f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:7734:x1876539149924608:12345-0@lo:104: Request processed in 81us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607303.309138:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607303.309174:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607303.309180:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d7c191e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:7734:x1876539149924736:12345-0@lo:104: 00010000:00010000:1.0:1789607303.309186:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309219:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607303.309222:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d7c191e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:7734:x1876539149924736:12345-0@lo:104: Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607303.309234:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789607303.309251:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607303.309255:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309261:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8ba2c50 already unused, calling callback (00000000b1689aef) 10000000:00010000:1.0:1789607303.309264:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.309503:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789607303.309531:0:7734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d4eb3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7734:1876539149924608:0@lo:104: 00000100:00100000:0.0:1789607303.309542:0:7734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cc7f211 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7734:1876539149924736:0@lo:104: 00010000:00010000:0.0:1789607303.309561:0:7734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309679:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607303.309688:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607303.309694:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607303.309819:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309829:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607303.309854:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309881:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000f8ba2c50/0xa26202d240fbd298 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd29f expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.309894:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607303.309895:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607303.309897:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607303.310009:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd90d2e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149924864:0@lo:103: 00000100:00100000:3.0:1789607303.310054:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607303.310205:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924864 00000100:00100000:1.0:1789607303.310218:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924864 00010000:00010000:1.0:1789607303.310239:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd298 expref: 18 pid: 6462 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607303.310269:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607303.310283:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003cc7f211 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+18:3468:x1876539149924864:12345-0@lo:103: 00010000:00010000:1.0:1789607303.310302:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607303.310306:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd298 expref: 18 pid: 6462 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.310316:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd298 expref: 18 pid: 6462 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.310330:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030c60999/0xa26202d240fbd29f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd298 expref: 18 pid: 6462 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.310341:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607303.310373:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003cc7f211 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+17:3468:x1876539149924864:12345-0@lo:103: Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607303.310379:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789607303.311075:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607303.311079:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607303.311081:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607303.311150:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.311160:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dfe1d441 already unused, calling callback (00000000b1689aef) 10000000:00010000:1.0:1789607303.311164:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.311171:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607303.311177:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607303.311190:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789607303.311267:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd90d2e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149924864:0@lo:103: 00010000:00010000:1.0:1789607303.314951:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.314969:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607303.315000:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.315007:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000dfe1d441/0xa26202d240fbd1aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd1b1 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607303.315032:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607303.315034:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607303.315036:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607303.315075:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607303.315095:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6dadfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149924992:0@lo:103: 00000100:00100000:0.0:1789607303.315158:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607303.318376:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149924992 00000100:00100000:2.0:1789607303.318393:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149924992 00010000:00010000:2.0:1789607303.318435:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607303.318568:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607303.318577:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1fad881 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+17:3468:x1876539149924992:12345-0@lo:103: 00010000:00010000:2.0:1789607303.318592:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607303.318597:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318608:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318642:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ddaaddbb/0xa26202d240fbd1b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd1aa expref: 17 pid: 6463 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318658:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318665:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318680:0:6455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318685:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318690:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318696:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318700:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a7a0107 already unused, calling callback (0000000051141bff) 00010000:00010000:2.0:1789607303.318703:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318951:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318970:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607303.318990:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607303.319066:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1fad881 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+16:3468:x1876539149924992:12345-0@lo:103: Request processed in 492us (3908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607303.319074:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789607303.319170:0:7734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.319192:0:7734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607303.319197:0:7734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a7a0107/0xa26202d240fbd332 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607303.319784:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6dadfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149924992:0@lo:103: 00010000:00010000:1.0:1789607303.331529:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607303.906119:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607303.906141:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cc8f81b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149925120:0@lo:41: 00000100:00100000:1.0:1789607303.906210:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607303.907204:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925120 00000100:00100000:2.0:1789607303.907217:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925120 00000100:00100000:2.0:1789607303.907278:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607303.907286:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f6dadfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149925120:12345-0@lo:41: 00000004:00000024:2.0:1789607303.907337:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607303.907409:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f6dadfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149925120:12345-0@lo:41: Request processed in 123us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607303.907415:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607303.910480:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cc8f81b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149925120:0@lo:41: 00010000:00010000:0.0:1789607304.358440:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607305.378349:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607306.405049:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607307.429277:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607308.003515:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000870f482f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149925248:0@lo:400: 00000100:00100000:0.0:1789607308.003628:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607308.003918:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607308.003930:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f85b71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149925376:0@lo:400: 00000100:00100000:3.0:1789607308.003969:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607308.004024:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925248 00000100:00100000:3.0:1789607308.004035:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925248 00000100:00100000:3.0:1789607308.004093:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789607308.004103:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077585091 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:3471:x1876539149925248:12345-0@lo:400: 00000100:00100000:3.0:1789607308.004160:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077585091 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:3471:x1876539149925248:12345-0@lo:400: Request processed in 59us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607308.004168:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789607308.004225:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000870f482f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149925248:0@lo:400: 00000100:00100000:2.0:1789607308.006602:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149925504:0@lo:400: 00000100:00100000:2.0:1789607308.006689:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607308.006762:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925504 00000100:00100000:2.0:1789607308.006772:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925504 00000100:00100000:2.0:1789607308.006825:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607308.006834:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004854721b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149925504:12345-0@lo:400: 00000100:00100000:2.0:1789607308.006913:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004854721b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149925504:12345-0@lo:400: Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607308.006921:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607308.006966:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149925504:0@lo:400: 00000100:00100000:2.0:1789607308.007022:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607308.007031:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149925632:0@lo:400: 00000100:00100000:2.0:1789607308.007059:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607308.007099:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925376 00000100:00100000:2.0:1789607308.007104:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925376 00000100:00100000:2.0:1789607308.007132:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925632 00000100:00100000:2.0:1789607308.007135:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925632 00000100:00100000:2.0:1789607308.007152:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607308.007157:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd4d4eb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149925376:12345-0@lo:400: 00000100:00100000:2.0:1789607308.007196:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd4d4eb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149925376:12345-0@lo:400: Request processed in 39us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607308.007203:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607308.007215:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607308.007220:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001935818d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149925632:12345-0@lo:400: 00000100:00100000:2.0:1789607308.007250:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001935818d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149925632:12345-0@lo:400: Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607308.007255:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789607308.007306:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e7f85b71 x1876539149925376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607308.007317:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f85b71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149925376:0@lo:400: 00010000:00080000:2.0:1789607308.007343:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ba212163 x1876539149925632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607308.007351:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149925632:0@lo:400: 00000100:00100000:2.0:1789607308.008847:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149925760:0@lo:400: 00000100:00100000:2.0:1789607308.008943:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607308.025727:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925760 00000100:00100000:0.0:1789607308.025750:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925760 00000100:00100000:0.0:1789607308.025834:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607308.025845:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f85b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149925760:12345-0@lo:400: 00000100:00100000:0.0:1789607308.026023:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f85b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149925760:12345-0@lo:400: Request processed in 179us (17079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607308.026032:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607308.026090:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000004:00080000:0.0:1789607308.026097:0:3471:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789607308.026123:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba212163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149925760:0@lo:400: 00010000:00010000:1.0:1789607308.451314:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607308.516280:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607308.516314:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a102bcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149925888:0@lo:41: 00000100:00100000:3.0:1789607308.516406:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607308.516491:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149925888 00000100:00100000:3.0:1789607308.516501:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149925888 00000100:00100000:3.0:1789607308.516557:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789607308.516565:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b6fa7c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149925888:12345-0@lo:41: 00000004:00000024:3.0:1789607308.516616:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607308.516662:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b6fa7c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149925888:12345-0@lo:41: Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607308.516688:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789607308.516747:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a102bcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149925888:0@lo:41: 00000100:00100000:1.0:1789607309.026041:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607309.035027:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5104386 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149926016:0@lo:41: 00000100:00100000:1.0:1789607309.035124:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607309.035277:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926016 00000100:00100000:0.0:1789607309.035289:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926016 00000100:00100000:0.0:1789607309.035363:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607309.035372:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000679a79ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149926016:12345-0@lo:41: 00000004:00000024:0.0:1789607309.035426:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607309.035494:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000679a79ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149926016:12345-0@lo:41: Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607309.035501:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607309.035643:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5104386 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149926016:0@lo:41: 00010000:00010000:1.0:1789607309.475949:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607310.052887:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607310.052907:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f05a9800 from 1 10000000:01000000:2.0:1789607310.052913:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607310.052967:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd339 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.052998:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd339 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.053011:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd339 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607310.053039:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926144:0@lo:101: 00000100:00100000:2.0:1789607310.053125:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.053177:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e30fe79 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.053202:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926144 00000100:00100000:2.0:1789607310.053212:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926144 00000100:00100000:2.0:1789607310.053286:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607310.053295:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000004d1801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149926144:12345-0@lo:101: 00010000:00010000:2.0:1789607310.053313:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607310.053328:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001a0a637/0xa26202d240fbd340 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd339 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.053357:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001a0a637/0xa26202d240fbd340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd339 expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.053368:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001a0a637/0xa26202d240fbd340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd339 expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.053377:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001a0a637, rc 0) 00000100:00100000:2.0:1789607310.053414:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000004d1801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149926144:12345-0@lo:101: Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.053421:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607310.053473:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926144:0@lo:101: 00010000:00010000:2.0:1789607310.053494:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd339 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.053503:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000071b9e9c/0xa26202d240fbd339 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607310.053561:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926272:0@lo:501: 00000100:00100000:2.0:1789607310.053585:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.053598:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e30fe79 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.053610:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926272 00000100:00100000:2.0:1789607310.053613:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926272 00000100:00100000:2.0:1789607310.053632:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789607310.053637:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e61b97e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149926272:12345-0@lo:501: 00000100:00100000:2.0:1789607310.053913:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e61b97e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149926272:12345-0@lo:501: Request processed in 276us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.053920:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789607310.053947:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926272:0@lo:501: 00000100:00100000:2.0:1789607310.053972:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926400:0@lo:503: 00000100:00100000:2.0:1789607310.054010:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.054028:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e30fe79 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.054039:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926400 00000100:00100000:2.0:1789607310.054042:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926400 00000100:00100000:2.0:1789607310.054061:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607310.054066:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a71a1c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149926400:12345-0@lo:503: 00000100:00100000:2.0:1789607310.055823:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a71a1c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149926400:12345-0@lo:503: Request processed in 1749us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.055839:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789607310.055952:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4afa564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926400:0@lo:503: 00000100:00100000:3.0:1789607310.057595:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a102bcc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8109:1876539149926528:0@lo:502: 00000100:00100000:3.0:1789607310.057708:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.057765:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a380667 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.058065:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926528 00000100:00100000:2.0:1789607310.058079:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926528 00000100:00100000:2.0:1789607310.058330:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607310.058341:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018fe9b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:8109:x1876539149926528:12345-0@lo:502: 00000100:00100000:2.0:1789607310.058661:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018fe9b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:8109:x1876539149926528:12345-0@lo:502: Request processed in 322us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.058669:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607310.058730:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a102bcc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8109:1876539149926528:0@lo:502: 00000020:01000000:2.0:1789607310.058764:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607310.058773:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607310.058776:0:8109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789607310.058782:0:8109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78f05a9800 00000020:00000080:2.0:1789607310.058785:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607310.058918:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8109:1876539149926656:0@lo:502: 00000100:00100000:2.0:1789607310.058963:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.058990:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926656 00000100:00100000:2.0:1789607310.058994:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926656 00000100:00100000:2.0:1789607310.059019:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789607310.059026:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:8109:x1876539149926656:12345-0@lo:502: 00000100:00100000:2.0:1789607310.063541:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:8109:x1876539149926656:12345-0@lo:502: Request processed in 4507us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.063554:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789607310.063639:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.063664:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8109:1876539149926656:0@lo:502: 00000020:01000000:2.0:1789607310.064768:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607310.064781:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607310.064783:0:8109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789607310.064788:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789607310.064901:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789607310.064923:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607310.064934:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.064947:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607310.064959:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607310.064961:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c75d7000 from 1 10000000:01000000:2.0:1789607310.064964:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607310.065003:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.065011:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.065021:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607310.065043:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926784:0@lo:101: 00000100:00100000:2.0:1789607310.065101:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.067074:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.067109:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926784 00000100:00100000:2.0:1789607310.067935:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926784 00000100:00100000:2.0:1789607310.068009:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789607310.068019:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149926784:12345-0@lo:101: 00010000:00010000:2.0:1789607310.068037:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607310.068058:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd347 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.068110:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd347 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.068399:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd347 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.068411:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:2.0:1789607310.068490:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149926784:12345-0@lo:101: Request processed in 473us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.068498:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607310.068561:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926784:0@lo:101: 00010000:00010000:3.0:1789607310.068598:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.068613:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607310.068717:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926912:0@lo:501: 00000100:00100000:3.0:1789607310.068783:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.068836:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.068946:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149926912 00000100:00100000:2.0:1789607310.068954:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149926912 00000100:00100000:2.0:1789607310.068994:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789607310.069056:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149926912:12345-0@lo:501: 00000100:00100000:2.0:1789607310.069763:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149926912:12345-0@lo:501: Request processed in 759us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.069776:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607310.069966:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149926912:0@lo:501: 00000100:00100000:3.0:1789607310.070020:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149927040:0@lo:503: 00000100:00100000:3.0:1789607310.070080:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.070115:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.073573:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927040 00000100:00100000:2.0:1789607310.073590:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927040 00000100:00100000:2.0:1789607310.073664:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789607310.073681:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149927040:12345-0@lo:503: 00000100:00100000:2.0:1789607310.074004:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149927040:12345-0@lo:503: Request processed in 326us (3921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.074014:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789607310.074073:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149927040:0@lo:503: 00000100:00100000:0.0:1789607310.075172:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8110:1876539149927168:0@lo:502: 00000100:00100000:0.0:1789607310.075287:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.075360:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.075364:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927168 00000100:00100000:2.0:1789607310.075380:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927168 00000100:00100000:2.0:1789607310.075824:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789607310.075849:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8110:x1876539149927168:12345-0@lo:502: 00000100:00100000:2.0:1789607310.076168:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8110:x1876539149927168:12345-0@lo:502: Request processed in 322us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.076217:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8110:1876539149927168:0@lo:502: 00000020:01000000:0.0:1789607310.076277:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607310.076293:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607310.076296:0:8110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789607310.076304:0:8110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78c75d7000 00000020:00000080:0.0:1789607310.076308:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789607310.076344:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8110:1876539149927296:0@lo:502: 00000100:00100000:0.0:1789607310.076399:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.076447:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.076722:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789607310.076778:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927296 00000100:00100000:2.0:1789607310.076785:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927296 00000100:00100000:2.0:1789607310.076830:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789607310.076845:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8110:x1876539149927296:12345-0@lo:502: 00000100:00100000:2.0:1789607310.077362:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8110:x1876539149927296:12345-0@lo:502: Request processed in 523us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.077372:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789607310.080980:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8110:1876539149927296:0@lo:502: 00000020:01000000:3.0:1789607310.081049:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607310.081060:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607310.081063:0:8110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789607310.081084:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789607310.081360:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789607310.081412:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607310.081424:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.081437:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789607310.340099:0:8107:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607310.340104:0:8107:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789607310.340496:0:8107:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d7901022000 00000020:01000004:2.0:1789607310.340517:0:8107:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789607310.340535:0:8107:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607310.340553:0:8107:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d78f05b0000) 00000020:00000080:2.0:1789607310.340585:0:8107:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789607310.360319:0:8107:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607310.360631:0:8107:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607310.426768:0:8107:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789607310.438363:0:8107:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789607310.438405:0:8107:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789607310.442778:0:8107:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789607310.442816:0:8107:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789607310.443326:0:8107:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789607310.443342:0:8107:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789607310.443362:0:8107:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa26202d240fbd35c 00000020:01000004:1.0:1789607310.443372:0:8107:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789607310.443398:0:8107:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789607310.443402:0:8107:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789607310.443410:0:8107:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789607310.443415:0:8107:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789607310.444103:0:8107:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d78f7688000) 00000020:00000080:1.0:1789607310.444122:0:8107:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789607310.446043:0:8107:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607310.452383:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789607310.452403:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789607310.456258:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607310.456276:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789607310.456832:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789607310.456841:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789607310.461065:0:8107:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607310.461331:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789607310.461340:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789607310.465688:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789607310.465709:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1789607310.498066:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607310.534232:0:8107:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607310.537195:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789607310.537208:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789607310.539223:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789607310.539238:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789607310.542162:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789607310.542184:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789607310.558573:0:8107:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607310.558825:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789607310.558843:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789607310.560706:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789607310.560720:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789607310.646521:0:8107:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607310.646778:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789607310.646784:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789607310.655147:0:8107:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789607310.655179:0:8107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789607310.656057:0:8107:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789607310.656086:0:8107:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789607310.656096:0:8107:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789607310.702703:0:8107:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789607310.702767:0:8107:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789607310.702771:0:8107:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789607310.702773:0:8107:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789607310.702775:0:8107:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607310.702777:0:8107:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607310.702778:0:8107:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607310.702780:0:8107:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607310.702781:0:8107:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607310.702783:0:8107:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607310.702784:0:8107:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607310.702786:0:8107:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607310.702787:0:8107:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607310.702791:0:8107:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789607310.702794:0:8107:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789607310.702796:0:8107:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789607310.702797:0:8107:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607310.702798:0:8107:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607310.702799:0:8107:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607310.702800:0:8107:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607310.702801:0:8107:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607310.702802:0:8107:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607310.702803:0:8107:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607310.702804:0:8107:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607310.702805:0:8107:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607310.702843:0:8107:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789607310.703114:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149927424:0@lo:253: 00000100:00100000:0.0:1789607310.703209:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.703306:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.703361:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927424 00000100:00100000:2.0:1789607310.703435:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927424 00000100:00100000:2.0:1789607310.703589:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789607310.703601:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8107:x1876539149927424:12345-0@lo:253: 20000000:01000000:2.0:1789607310.703639:0:6463:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789607310.703644:0:6463:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789607310.703650:0:6463:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789607310.703654:0:6463:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789607310.704981:0:6463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607310.705226:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789607310.705250:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789607310.705296:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789607310.705306:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789607310.705336:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789607310.705457:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789607310.706216:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789607310.706253:0:6463:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:0.0:1789607310.706256:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:0.0:1789607310.706295:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789607310.706304:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789607310.706354:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789607310.706362:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:0.0:1789607310.706469:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789607310.706480:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789607310.706533:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789607310.706589:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789607310.707219:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789607310.707238:0:6463:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:0.0:1789607310.707248:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:0.0:1789607310.707283:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789607310.707292:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789607310.707334:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789607310.707342:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:0.0:1789607310.707444:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789607310.707454:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789607310.707488:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789607310.707538:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789607310.709285:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789607310.709324:0:6463:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:0.0:1789607310.709327:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:0.0:1789607310.709365:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789607310.711973:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789607310.712107:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789607310.712116:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:0.0:1789607310.712152:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789607310.712163:0:6463:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789607310.712270:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789607310.712315:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789607310.712342:0:6463:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789607310.712346:0:6463:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789607310.712351:0:6463:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789607310.712379:0:6463:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789607310.712383:0:6463:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789607310.712437:0:6463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789607310.712440:0:6463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789607310.713997:0:8124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789607310.714512:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789607310.714564:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789607310.714680:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789607310.714694:0:6463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789607310.714697:0:6463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789607310.720974:0:8125:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789607310.721106:0:8125:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789607310.721166:0:8125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789607310.721833:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789607310.721915:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789607310.721987:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1789607310.722090:0:6463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789607310.722093:0:6463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789607310.722775:0:8126:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789607310.722832:0:8126:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789607310.722915:0:8126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789607310.723528:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1789607310.723576:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1789607310.723615:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1789607310.723628:0:6463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789607310.723631:0:6463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607310.724703:0:8127:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607310.724794:0:8127:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607310.724849:0:8127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789607310.725312:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789607310.725357:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789607310.725771:0:6463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789607310.725794:0:6463:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789607310.725797:0:6463:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789607310.725809:0:6463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789607310.725835:0:6463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725897:0:6463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd22f expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725906:0:6463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725912:0:6463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2de expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725919:0:6463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725925:0:6463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd324 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725932:0:6463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.725983:0:6463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd324 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.726557:0:6463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd324 expref: 18 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.726578:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927552:0@lo:104: 00000100:00100000:0.0:1789607310.726665:0:6463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607310.726736:0:6463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.726745:0:6463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 18 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.726764:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbdc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927680:0@lo:104: 00000100:00100000:0.0:1789607310.726787:0:6463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607310.726933:0:6463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd2de expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.726942:0:6463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd2de expref: 18 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.726950:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927808:0@lo:104: 00000100:00100000:0.0:1789607310.726973:0:6463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607310.733984:0:6463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.734238:0:6463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 18 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.734268:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927936:0@lo:104: 00000100:00100000:0.0:1789607310.734344:0:6463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.734399:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927552 00000100:00100000:1.0:1789607310.734411:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927552 00000100:00100000:1.0:1789607310.734477:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927680 00000100:00100000:1.0:1789607310.734480:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927680 00000100:00100000:1.0:1789607310.734495:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927808 00000100:00100000:1.0:1789607310.734498:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927808 00000100:00100000:1.0:1789607310.734514:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607310.734525:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:6463:x1876539149927552:12345-0@lo:104: 00010000:00010000:1.0:1789607310.734543:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.734668:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607310.734675:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:6463:x1876539149927552:12345-0@lo:104: Request processed in 152us (8011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.734683:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607310.734707:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607310.734714:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:6463:x1876539149927680:12345-0@lo:104: 00010000:00010000:1.0:1789607310.734723:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.734766:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607310.734772:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:6463:x1876539149927680:12345-0@lo:104: Request processed in 59us (7984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.734778:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607310.734790:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607310.734796:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:6463:x1876539149927808:12345-0@lo:104: 00010000:00010000:1.0:1789607310.734804:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.734839:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789607310.734844:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:6463:x1876539149927808:12345-0@lo:104: Request processed in 49us (7871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.734849:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789607310.734897:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607310.734904:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.734912:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607310.734924:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.734933:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607310.734941:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607310.734948:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607310.734983:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.734990:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607310.735028:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735037:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075c600/0xa26202d240fbd324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd32b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735056:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607310.735059:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735065:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607310.735068:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735075:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607310.735091:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607310.735097:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607310.735112:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735117:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607310.735123:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735130:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd301 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735139:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607310.735142:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735147:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79021da400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607310.735150:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735156:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607310.735163:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607310.735168:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607310.735189:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735195:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607310.735211:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735218:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d79021da400/0xa26202d240fbd2de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2e5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735228:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607310.735230:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607310.735232:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607310.735247:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607310.735264:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149928064:0@lo:103: 00000100:00100000:1.0:1789607310.735299:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.735339:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607310.735346:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149928192:0@lo:103: 00000100:00100000:1.0:1789607310.735367:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.735413:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149928320:0@lo:103: 00000100:00100000:1.0:1789607310.735450:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.735493:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928064 00000100:00100000:1.0:1789607310.735498:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928064 00010000:00010000:1.0:1789607310.735522:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd324 expref: 19 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.735542:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928192 00000100:00100000:1.0:1789607310.735545:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928192 00010000:00010000:1.0:1789607310.735556:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 20 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.735580:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928320 00000100:00100000:1.0:1789607310.735583:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928320 00010000:00010000:1.0:1789607310.735595:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2de expref: 21 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.735608:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607310.735615:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+21:3470:x1876539149928064:12345-0@lo:103: 00010000:00010000:1.0:1789607310.735627:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607310.735633:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd324 expref: 21 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735644:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd324 expref: 21 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735664:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607310.735696:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+21:3470:x1876539149928064:12345-0@lo:103: Request processed in 82us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.735702:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607310.735716:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607310.735723:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+20:3470:x1876539149928192:12345-0@lo:103: 00010000:00010000:1.0:1789607310.735730:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607310.735735:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 20 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735743:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 20 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735751:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607310.735778:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+20:3470:x1876539149928192:12345-0@lo:103: Request processed in 56us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.735785:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607310.735798:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607310.735804:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3468:x1876539149928320:12345-0@lo:103: 00010000:00010000:1.0:1789607310.735811:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607310.735816:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2de expref: 19 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735825:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd2de expref: 19 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.735835:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607310.735885:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3468:x1876539149928320:12345-0@lo:103: Request processed in 58us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.735891:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607310.735935:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149928320:0@lo:103: 00000100:00100000:1.0:1789607310.735967:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149928192:0@lo:103: 00000100:00100000:1.0:1789607310.735975:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149928064:0@lo:103: 00010000:00010000:2.0:1789607310.736316:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607310.737535:0:6463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd22f expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.737555:0:6463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd22f expref: 18 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.737570:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149928448:0@lo:104: 00000100:00100000:0.0:1789607310.737628:0:6463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.737697:0:6463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789607310.737728:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184a00/0xa26202d240fbd32b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd324 expref: 18 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.737763:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927552:0@lo:104: 00010000:00010000:0.0:1789607310.737779:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052000/0xa26202d240fbd301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd2fa expref: 17 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.737788:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbdc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927680:0@lo:104: 00010000:00010000:0.0:1789607310.737799:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd2e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd2de expref: 16 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.737808:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927808:0@lo:104: 00000100:00100000:1.0:1789607310.738357:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149927936 00000100:00100000:1.0:1789607310.738367:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149927936 00000100:00100000:1.0:1789607310.738490:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928448 00000100:00100000:1.0:1789607310.738494:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928448 00000100:00100000:1.0:1789607310.738511:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607310.738522:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:6463:x1876539149927936:12345-0@lo:104: 00010000:00010000:1.0:1789607310.738541:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.738678:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607310.738685:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:6463:x1876539149927936:12345-0@lo:104: Request processed in 166us (4342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.738693:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607310.738715:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607310.738721:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:6463:x1876539149928448:12345-0@lo:104: 00010000:00010000:1.0:1789607310.738729:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.738801:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149927936:0@lo:104: 00000100:00100000:0.0:1789607310.738810:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6463:1876539149928448:0@lo:104: 00010000:00010000:0.0:1789607310.738841:0:6463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739336:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607310.739346:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739356:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79021db000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607310.739360:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739438:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607310.739448:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607310.739454:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607310.739550:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739558:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607310.739592:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739600:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d79021db000/0xa26202d240fbd2a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2ad expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739615:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607310.739619:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739624:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79021db600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607310.739640:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.739647:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607310.739653:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607310.739658:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789607310.739703:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149928576:0@lo:103: 00000100:00100000:0.0:1789607310.739759:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607310.739879:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789607310.739889:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:6463:x1876539149928448:12345-0@lo:104: Request processed in 1166us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.739897:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607310.739928:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928576 00000100:00100000:1.0:1789607310.739935:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928576 00010000:00010000:1.0:1789607310.739959:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.739985:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607310.739993:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+16:3469:x1876539149928576:12345-0@lo:103: 00010000:00010000:0.0:1789607310.740098:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607310.740512:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607310.740524:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.740539:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.740573:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd2ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd2a6 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.740595:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607310.740667:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+15:3469:x1876539149928576:12345-0@lo:103: Request processed in 675us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.740675:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607310.740765:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149928576:0@lo:103: 00010000:00010000:2.0:1789607310.741459:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.741468:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789607310.741519:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789607310.741570:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.741577:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd22f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd236 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.741595:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607310.741597:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607310.741600:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607310.741691:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149928704:0@lo:103: 00000100:00100000:0.0:1789607310.741747:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.741974:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928704 00000100:00100000:1.0:1789607310.741983:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928704 00010000:00010000:1.0:1789607310.742201:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd22f expref: 15 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.742281:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607310.742292:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f06acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+15:3471:x1876539149928704:12345-0@lo:103: 00010000:00010000:1.0:1789607310.742307:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607310.742312:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd22f expref: 15 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742324:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd22f expref: 15 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742340:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021da600/0xa26202d240fbd236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd22f expref: 15 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742356:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742366:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742414:0:6455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742422:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742430:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742437:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742443:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607310.742447:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742456:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742477:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.742489:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607310.742545:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f06acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+14:3471:x1876539149928704:12345-0@lo:103: Request processed in 255us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.742552:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789607310.742770:0:6463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.742779:0:6463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.742792:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd36a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607310.742806:0:6463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789607310.745554:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149928704:0@lo:103: 00000100:00100000:3.0:1789607310.819808:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+13:8107:x1876539149927424:12345-0@lo:253: Request processed in 116196us (116586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.819826:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607310.820082:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149927424:0@lo:253: 10000000:01000000:1.0:1789607310.820101:0:8107:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789607310.820122:0:8107:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789607310.820124:0:8107:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789607310.820126:0:8107:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607310.820127:0:8107:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789607310.820128:0:8107:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607310.820129:0:8107:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607310.820131:0:8107:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607310.820132:0:8107:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789607310.820134:0:8107:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607310.820136:0:8107:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789607310.820159:0:8107:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d7901022000 from lustre-OST0000 10000000:01000000:1.0:1789607310.820190:0:8107:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789607310.820193:0:8107:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789607310.820204:0:8107:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78e9ee99c0 local copy 10000000:01000000:1.0:1789607310.820209:0:8107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789607310.820273:0:8107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.820287:0:8107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.820298:0:8107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.820320:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149928832:0@lo:101: 00000100:00100000:1.0:1789607310.820363:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.820410:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.820532:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928832 00000100:00100000:2.0:1789607310.820539:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928832 00000100:00100000:2.0:1789607310.820586:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789607310.820596:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+13:8107:x1876539149928832:12345-0@lo:101: 00010000:00010000:2.0:1789607310.820611:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607310.820627:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd371 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.820669:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd371 expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.820682:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd371 expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.820692:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185400, rc 0) 00000100:00100000:2.0:1789607310.820736:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149928832:12345-0@lo:101: Request processed in 141us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.820742:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789607310.821049:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149928832:0@lo:101: 00010000:00010000:1.0:1789607310.821066:0:8107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.821077:0:8107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.821433:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149928960:0@lo:501: 00000100:00100000:1.0:1789607310.821473:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.821564:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607310.824841:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149928960 00000100:00100000:3.0:1789607310.824878:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149928960 00000100:00100000:2.0:1789607310.829657:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789607310.829675:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149928960:12345-0@lo:501: 00000100:00100000:2.0:1789607310.830169:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149928960:12345-0@lo:501: Request processed in 497us (8694us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607310.830179:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789607310.833523:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149928960:0@lo:501: 10000000:01000000:1.0:1789607310.833566:0:8107:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789607310.833648:0:8107:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789607310.833660:0:8107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.833673:0:8107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.833681:0:8107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.833711:0:8107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789607310.833750:0:8107:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7901022000 10000000:01000000:1.0:1789607310.833757:0:8107:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789607310.833765:0:8107:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789607310.833767:0:8107:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607310.833773:0:8107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789607310.833776:0:8107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789607310.833820:0:8107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.833828:0:8107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.833881:0:8107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.833908:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929088:0@lo:101: 00000100:00100000:1.0:1789607310.833991:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.834037:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607310.834171:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929088 00000100:00100000:0.0:1789607310.834180:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929088 00000100:00100000:0.0:1789607310.834271:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789607310.834283:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149929088:12345-0@lo:101: 00010000:00010000:0.0:1789607310.834307:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607310.834325:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd37f expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.834356:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd37f expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.834368:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd37f expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.834378:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c800, rc 0) 00000100:00100000:0.0:1789607310.834431:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929088:12345-0@lo:101: Request processed in 150us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.834437:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789607310.834696:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929088:0@lo:101: 00010000:00010000:1.0:1789607310.834713:0:8107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.834723:0:8107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607310.834813:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929216:0@lo:501: 00000100:00100000:1.0:1789607310.834841:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.834900:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607310.834974:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929216 00000100:00100000:3.0:1789607310.834979:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929216 00000100:00100000:3.0:1789607310.835018:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607310.835027:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929216:12345-0@lo:501: 00000100:00100000:3.0:1789607310.835324:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929216:12345-0@lo:501: Request processed in 298us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.835331:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607310.835521:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929216:0@lo:501: 00000100:00100000:1.0:1789607310.835552:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929344:0@lo:503: 00000100:00100000:1.0:1789607310.835592:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.835615:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607310.835678:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929344 00000100:00100000:0.0:1789607310.835683:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929344 00000100:00100000:0.0:1789607310.835714:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789607310.835722:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929344:12345-0@lo:503: 00000100:00100000:0.0:1789607310.835911:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929344:12345-0@lo:503: Request processed in 189us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.835928:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789607310.836013:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929344:0@lo:503: 00000040:00080000:1.0:1789607310.836369:0:8107:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607310.836445:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929472:0@lo:502: 00000100:00100000:1.0:1789607310.836489:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.836528:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607310.836742:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929472 00000100:00100000:0.0:1789607310.836748:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929472 00000100:00100000:0.0:1789607310.836783:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789607310.836790:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929472:12345-0@lo:502: 00000100:00100000:0.0:1789607310.836983:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929472:12345-0@lo:502: Request processed in 192us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.836990:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:2.0:1789607310.837108:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607310.837119:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.837130:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607310.837135:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.837146:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607310.837154:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607310.837168:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607310.837198:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.837205:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607310.837249:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.837256:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd378 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.837271:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607310.837273:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607310.837275:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607310.837563:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149929600:0@lo:103: 00000100:00100000:2.0:1789607310.837607:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.837713:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929600 00000100:00100000:0.0:1789607310.837718:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929600 00000100:00100000:0.0:1789607310.837771:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607310.837779:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+15:3471:x1876539149929600:12345-0@lo:103: 00010000:00010000:0.0:1789607310.837793:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607310.837810:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd371 expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.837825:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607310.837899:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+14:3471:x1876539149929600:12345-0@lo:103: Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.837906:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607310.838051:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149929600:0@lo:103: 00000100:00100000:1.0:1789607310.838137:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929472:0@lo:502: 00000040:00080000:1.0:1789607310.838637:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789607310.838708:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789607310.838743:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789607310.838807:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789607310.838845:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789607310.839195:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789607310.839376:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929728:0@lo:502: 00000100:00100000:1.0:1789607310.839448:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.839539:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607310.842110:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929728 00000100:00100000:0.0:1789607310.842129:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929728 00000100:00100000:0.0:1789607310.842214:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789607310.842234:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149929728:12345-0@lo:502: 00000100:00100000:0.0:1789607310.842587:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149929728:12345-0@lo:502: Request processed in 356us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.842596:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607310.843094:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929728:0@lo:502: 00000040:00080000:1.0:1789607310.843334:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789607310.843353:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789607310.844304:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789607310.844317:0:8130:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789607310.844326:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607310.844329:0:8130:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789607310.844334:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607310.844372:0:8130:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d77c41919c0) 00000020:00000080:1.0:1789607310.844412:0:8130:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789607310.844420:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789607310.844500:0:8130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7901022000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789607310.844508:0:8130:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789607310.844516:0:8130:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa26202d240fbd394 00010000:00010000:1.0:1789607310.850547:0:8130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789607310.851036:0:8130:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789607310.853049:0:8130:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789607310.854402:0:8130:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789607310.863669:0:8130:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789607310.864269:0:8130:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789607310.866069:0:8130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789607310.866087:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607310.866099:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607310.866102:0:8130:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789607310.866107:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607310.866111:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607310.866113:0:8130:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607310.866117:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607310.866119:0:8130:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789607310.866189:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607310.866193:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607310.866194:0:8130:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789607310.866198:0:8130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789607310.868633:0:8107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789607310.868689:0:8107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789607310.877004:0:8107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.877028:0:8107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607310.877038:0:8107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7901022000 from 1 10000000:01000000:2.0:1789607310.877050:0:8107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607310.877102:0:8107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.877111:0:8107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.877125:0:8107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607310.877155:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929856:0@lo:101: 00000100:00100000:2.0:1789607310.877269:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.877540:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607310.883536:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929856 00000100:00100000:1.0:1789607310.883559:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929856 00000100:00100000:1.0:1789607310.883642:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789607310.883655:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149929856:12345-0@lo:101: 00010000:00010000:1.0:1789607310.883676:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607310.883700:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd39b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.883736:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd39b expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.883749:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd39b expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607310.883757:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902053c00, rc 0) 00000100:00100000:1.0:1789607310.884029:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929856:12345-0@lo:101: Request processed in 377us (6761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.884037:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789607310.888415:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929856:0@lo:101: 00010000:00010000:2.0:1789607310.888452:0:8107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.888467:0:8107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607310.888747:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929984:0@lo:501: 00000100:00100000:3.0:1789607310.888829:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.888912:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.889120:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149929984 00000100:00100000:2.0:1789607310.889128:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149929984 00000100:00100000:2.0:1789607310.889184:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789607310.889195:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929984:12345-0@lo:501: 00000100:00100000:2.0:1789607310.889562:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149929984:12345-0@lo:501: Request processed in 367us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.889571:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789607310.893292:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149929984:0@lo:501: 00000100:00100000:0.0:1789607310.893385:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930112:0@lo:503: 00000100:00100000:0.0:1789607310.893493:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.893555:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607310.893639:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930112 00000100:00100000:1.0:1789607310.893648:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930112 00000100:00100000:1.0:1789607310.893715:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789607310.893726:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930112:12345-0@lo:503: 00000100:00100000:1.0:1789607310.894031:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930112:12345-0@lo:503: Request processed in 306us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.894039:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789607310.894266:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930112:0@lo:503: 00000040:00080000:0.0:1789607310.894624:0:8107:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607310.894714:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930240:0@lo:502: 00000100:00100000:0.0:1789607310.894771:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.894815:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607310.895091:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930240 00000100:00100000:3.0:1789607310.895099:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930240 00000100:00100000:3.0:1789607310.895140:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607310.895150:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930240:12345-0@lo:502: 00000100:00100000:3.0:1789607310.895365:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930240:12345-0@lo:502: Request processed in 216us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.895371:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789607310.895813:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930240:0@lo:502: 00000040:00080000:0.0:1789607310.896122:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789607310.896178:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789607310.896210:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930368:0@lo:502: 00000100:00100000:0.0:1789607310.896395:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.896430:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607310.896505:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930368 00000100:00100000:3.0:1789607310.896512:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930368 00000100:00100000:3.0:1789607310.896547:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789607310.896555:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930368:12345-0@lo:502: 00000100:00100000:3.0:1789607310.896736:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930368:12345-0@lo:502: Request processed in 181us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.896743:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789607310.896829:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930368:0@lo:502: 00000040:00080000:0.0:1789607310.896967:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789607310.896979:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789607310.899177:0:8134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607310.899195:0:8134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607310.899198:0:8134:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789607310.899207:0:8134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7901022000 00000020:00000080:1.0:1789607310.899210:0:8134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607310.899251:0:8134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607310.899255:0:8134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607310.899257:0:8134:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789607310.899261:0:8134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789607310.899464:0:8107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789607310.899503:0:8107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607310.899534:0:8107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.899550:0:8107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607310.899608:0:8107:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789607310.899629:0:8107:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7901022000 10000000:01000000:0.0:1789607310.899633:0:8107:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7901022000 10000000:01000000:0.0:1789607310.899638:0:8107:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607310.899646:0:8107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7901022000 from 1 10000000:01000000:0.0:1789607310.899649:0:8107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607310.899699:0:8107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.899709:0:8107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.899723:0:8107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.899752:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930496:0@lo:101: 00000100:00100000:0.0:1789607310.899845:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.899925:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.900319:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930496 00000100:00100000:2.0:1789607310.900330:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930496 00000100:00100000:2.0:1789607310.900399:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789607310.900410:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8107:x1876539149930496:12345-0@lo:101: 00010000:00010000:2.0:1789607310.900428:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607310.900444:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd3a9 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.900473:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.900485:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.900494:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185400, rc 0) 00000100:00100000:2.0:1789607310.900557:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930496:12345-0@lo:101: Request processed in 150us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.900564:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789607310.900664:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930496:0@lo:101: 00010000:00010000:0.0:1789607310.900681:0:8107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607310.900692:0:8107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607310.900816:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930624:0@lo:501: 00000100:00100000:0.0:1789607310.900847:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.901014:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.901088:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930624 00000100:00100000:2.0:1789607310.901093:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930624 00000100:00100000:2.0:1789607310.901128:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789607310.901136:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930624:12345-0@lo:501: 00000100:00100000:2.0:1789607310.901658:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930624:12345-0@lo:501: Request processed in 520us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.901666:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789607310.902287:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930624:0@lo:501: 00000100:00100000:0.0:1789607310.902344:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930752:0@lo:503: 00000100:00100000:0.0:1789607310.903086:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.903143:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607310.903237:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930752 00000100:00100000:3.0:1789607310.903255:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930752 00000100:00100000:3.0:1789607310.903326:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607310.903337:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930752:12345-0@lo:503: 00000100:00100000:3.0:1789607310.903588:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930752:12345-0@lo:503: Request processed in 253us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.903597:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789607310.904031:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930752:0@lo:503: 00000040:00080000:0.0:1789607310.904399:0:8107:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607310.904501:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930880:0@lo:502: 00000100:00100000:0.0:1789607310.904555:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.904587:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.904718:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149930880 00000100:00100000:2.0:1789607310.904725:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149930880 00000100:00100000:2.0:1789607310.904773:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789607310.904783:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930880:12345-0@lo:502: 00000100:00100000:2.0:1789607310.905063:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149930880:12345-0@lo:502: Request processed in 282us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.905078:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789607310.905395:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149930880:0@lo:502: 00000040:00080000:0.0:1789607310.905671:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789607310.905725:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789607310.905753:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789607310.905788:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789607310.905816:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789607310.905853:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789607310.905916:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789607310.905959:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789607310.906000:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789607310.906031:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789607310.906060:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789607310.906111:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789607310.906145:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789607310.906174:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789607310.906215:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789607310.906573:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789607310.906607:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789607310.906656:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789607310.906690:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789607310.906721:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789607310.906787:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789607310.906828:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789607310.907734:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789607310.907894:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789607310.907938:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789607310.907972:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789607310.908023:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789607310.908056:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789607310.908087:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789607310.908130:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789607310.908166:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789607310.908197:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789607310.908490:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789607310.908544:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789607310.908574:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789607310.908610:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789607310.908637:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789607310.908701:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149931008:0@lo:502: 00000100:00100000:0.0:1789607310.908804:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.908892:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607310.909054:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931008 00000100:00100000:1.0:1789607310.909064:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931008 00000100:00100000:1.0:1789607310.909127:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789607310.909138:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149931008:12345-0@lo:502: 00000100:00100000:1.0:1789607310.909419:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149931008:12345-0@lo:502: Request processed in 282us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.909428:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789607310.909652:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149931008:0@lo:502: 00000040:00080000:0.0:1789607310.909746:0:8107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789607310.909758:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789607310.910704:0:8135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789607310.910725:0:8135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d78f05b4d40) 00000020:00000080:2.0:1789607310.910754:0:8135:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789607310.910850:0:8135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7901022000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789607310.910855:0:8135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7901022000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789607310.911046:0:8135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7901022000 3 00010000:00080000:3.0:1789607310.911435:0:8135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7901feb800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1789607310.913621:0:8135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789607310.913991:0:8135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789607310.914044:0:8135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789607310.914068:0:8135:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa26202d240fbd3be 00000100:00080000:3.0:1789607310.914081:0:8135:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607310.914095:0:8135:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d7901feb800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607310.914145:0:8135:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78facc4380 x1876539149931136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607310.914176:0:8135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789607310.914653:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149931392:0@lo:400: 00000100:00100000:2.0:1789607310.914741:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.914792:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607310.914799:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149931264:0@lo:400: 00000100:00100000:2.0:1789607310.914826:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.914857:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149931520:0@lo:400: 00000100:00100000:2.0:1789607310.914920:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.914940:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607310.914946:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149931648:0@lo:400: 00000100:00100000:2.0:1789607310.914967:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607310.915005:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931392 00000100:00100000:2.0:1789607310.915015:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931392 00000100:00100000:2.0:1789607310.915052:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931648 00000100:00100000:2.0:1789607310.915055:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931648 00000100:00100000:2.0:1789607310.915074:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607310.915084:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149931392:12345-0@lo:400: 00000100:00100000:2.0:1789607310.915146:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149931392:12345-0@lo:400: Request processed in 63us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.915154:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607310.915170:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607310.915187:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149931648:12345-0@lo:400: 00000100:00100000:2.0:1789607310.915236:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149931648:12345-0@lo:400: Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.915251:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607310.915274:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931264 00000100:00100000:2.0:1789607310.915277:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931264 00000100:00100000:2.0:1789607310.915303:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931520 00000100:00100000:2.0:1789607310.915306:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931520 00000100:00100000:2.0:1789607310.915331:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607310.915338:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149931264:12345-0@lo:400: 00000100:00100000:2.0:1789607310.915368:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149931264:12345-0@lo:400: Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.915373:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607310.915384:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607310.915389:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149931520:12345-0@lo:400: 00000100:00100000:2.0:1789607310.915415:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149931520:12345-0@lo:400: Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607310.915420:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607310.915477:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149931648:0@lo:400: 00010000:00080000:2.0:1789607310.915491:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78f075c700 x1876539149931520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607310.915501:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149931520:0@lo:400: 00010000:00080000:2.0:1789607310.915556:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78f075f100 x1876539149931264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607310.915566:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149931264:0@lo:400: 00000100:00100000:2.0:1789607310.915588:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149931392:0@lo:400: 00000020:01000004:2.0:1789607310.915724:0:8135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789607310.915756:0:8135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d77c4554d40) 00000020:00000080:2.0:1789607310.915781:0:8135:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789607310.915890:0:8135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7901022000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789607310.915894:0:8135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7901022000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789607310.915898:0:8135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7901022000 3 00010000:00080000:2.0:1789607310.915934:0:8135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c4447000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.125@tcp at head 00000100:00100000:1.0:1789607310.918056:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539149931136:0@lo:38: 00000100:00100000:1.0:1789607310.918152:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607310.918265:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931136 00000100:00100000:1.0:1789607310.918274:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931136 00000100:00100000:1.0:1789607310.918318:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607310.918326:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539149931136:12345-0@lo:38: 00010000:00080000:1.0:1789607310.918361:0:6468:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1789607310.918401:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa26202d240fbd3cc 00000004:00100000:1.0:1789607310.918434:0:6468:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789607310.918478:0:6468:0:(import.c:65:import_set_state_nolock()) ffff8d77c419e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607310.918542:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3467:x1876539149931136:12345-0@lo:38: Request processed in 214us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607310.918549:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789607310.918601:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78facc4380 x1876539149931136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607310.918613:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607310.918623:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789607310.918633:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789607310.918639:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607310.918641:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607310.918648:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539149931136:0@lo:38: 00010000:00010000:0.0:1789607310.923584:0:8135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1789607310.923818:0:8135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789607310.923891:0:8135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607310.923908:0:8135:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa26202d240fbd3d3 00000100:00080000:0.0:1789607310.923921:0:8135:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607310.923937:0:8135:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d77c4447000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607310.923985:0:8135:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78facbc380 x1876539149931776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607310.924012:0:8135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789607310.924338:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539149931776:0@lo:38: 00000100:00100000:1.0:1789607310.924432:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607310.926623:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931776 00000100:00100000:0.0:1789607310.926641:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931776 00000100:00100000:0.0:1789607310.926712:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607310.926723:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3467:x1876539149931776:12345-0@lo:38: 00010000:00080000:0.0:1789607310.926764:0:7709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1789607310.926806:0:7709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa26202d240fbd3da 00000004:00100000:0.0:1789607310.926829:0:7709:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607310.926890:0:7709:0:(import.c:65:import_set_state_nolock()) ffff8d77c4432800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607310.927218:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3467:x1876539149931776:12345-0@lo:38: Request processed in 495us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607310.927227:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789607310.928680:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78facbc380 x1876539149931776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607310.928695:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607310.928709:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789607310.928720:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789607310.928726:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789607310.928730:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4447000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607310.928738:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539149931776:0@lo:38: 00000040:00080000:0.0:1789607310.929397:0:8135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789607310.929547:0:8107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789607310.929583:0:8107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607310.929642:0:8107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.929655:0:8107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607310.929724:0:8107:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607310.929726:0:8107:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607310.929728:0:8107:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607310.929729:0:8107:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607310.929731:0:8107:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607310.929732:0:8107:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607310.929733:0:8107:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607310.929735:0:8107:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607310.929737:0:8107:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607310.929739:0:8107:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607310.929740:0:8107:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607310.929745:0:8107:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789607310.929748:0:8107:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607310.929749:0:8107:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607310.929751:0:8107:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607310.929752:0:8107:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607310.929753:0:8107:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607310.929754:0:8107:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607310.929755:0:8107:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607310.929756:0:8107:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607310.929757:0:8107:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607310.929758:0:8107:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607310.929759:0:8107:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607310.929789:0:8107:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789607310.929811:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149931904:0@lo:253: 00000100:00100000:3.0:1789607310.929931:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.929975:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607310.930049:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149931904 00000100:00100000:2.0:1789607310.930058:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149931904 00000100:00100000:2.0:1789607310.930111:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789607310.930122:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:8107:x1876539149931904:12345-0@lo:253: 20000000:01000000:2.0:1789607310.930153:0:6464:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789607310.930168:0:6464:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789607310.952122:0:6464:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789607310.952168:0:6464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789607310.952630:0:6484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607310.952637:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607310.952667:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.952692:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 16 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.952701:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 16 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.952709:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.952760:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 16 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.952801:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 16 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607310.952821:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149932032:0@lo:104: 00000100:00100000:2.0:1789607310.952946:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607310.952997:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 16 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607310.953007:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607310.953016:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149932160:0@lo:104: 00000100:00100000:2.0:1789607310.953037:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607310.953304:0:6452:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607310.953340:0:6452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.953368:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932032 00000100:00100000:3.0:1789607310.953377:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932032 00000100:00100000:3.0:1789607310.953425:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932160 00000100:00100000:3.0:1789607310.953428:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932160 00000100:00100000:3.0:1789607310.953444:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607310.953454:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901070450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6484:x1876539149932032:12345-0@lo:104: 00010000:00010000:3.0:1789607310.953469:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953534:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607310.953541:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901070450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6484:x1876539149932032:12345-0@lo:104: Request processed in 89us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.953549:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607310.953593:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607310.953601:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149932160:12345-0@lo:104: 00010000:00010000:3.0:1789607310.953609:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953642:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607310.953648:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149932160:12345-0@lo:104: Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.953654:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607310.953699:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149932032:0@lo:104: 00000100:00100000:3.0:1789607310.953708:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149932160:0@lo:104: 00010000:00010000:3.0:1789607310.953732:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953760:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607310.953767:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953775:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607310.953780:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953789:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607310.953797:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607310.953804:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607310.953839:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953846:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607310.953892:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953900:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbd2ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2f3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953916:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607310.953920:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953936:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607310.953939:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953946:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607310.953953:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607310.953959:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607310.953974:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953980:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607310.953986:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.953993:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185000/0xa26202d240fbd2d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd2d7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954008:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607310.954011:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607310.954013:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607310.954020:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607310.954042:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149932288:0@lo:103: 00000100:00100000:3.0:1789607310.954087:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.954116:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607310.954122:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149932416:0@lo:103: 00000100:00100000:3.0:1789607310.954150:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607310.954186:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932288 00000100:00100000:3.0:1789607310.954191:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932288 00010000:00010000:3.0:1789607310.954212:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 17 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607310.954234:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932416 00000100:00100000:3.0:1789607310.954248:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932416 00010000:00010000:3.0:1789607310.954259:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 18 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607310.954280:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607310.954287:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+18:3468:x1876539149932288:12345-0@lo:103: 00010000:00010000:3.0:1789607310.954300:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607310.954306:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 18 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954316:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 18 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954330:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052800/0xa26202d240fbd2f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd2ec expref: 18 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954344:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607310.954373:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+17:3468:x1876539149932288:12345-0@lo:103: Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.954380:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607310.954394:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607310.954400:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+16:3468:x1876539149932416:12345-0@lo:103: 00010000:00010000:3.0:1789607310.954419:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607310.954428:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954436:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954445:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd2d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd2d0 expref: 16 pid: 6462 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954458:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954467:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607310.954481:0:6454:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003448739s 00010000:00010000:3.0:1789607310.954486:0:6454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954494:0:6454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954502:0:6454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954508:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954514:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607310.954519:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954526:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954550:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954561:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607310.954586:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+15:3468:x1876539149932416:12345-0@lo:103: Request processed in 187us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.954592:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789607310.954639:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954647:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607310.954653:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd3e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607310.954684:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149932416:0@lo:103: 00000100:00100000:3.0:1789607310.954692:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149932288:0@lo:103: 00000100:00100000:3.0:1789607310.963733:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:8107:x1876539149931904:12345-0@lo:253: Request processed in 33598us (33787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607310.963752:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789607310.963857:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:8107:1876539149931904:0@lo:253: 10000000:01000000:0.0:1789607310.964024:0:8107:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789607310.964028:0:8107:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607310.964030:0:8107:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789607310.964032:0:8107:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607310.964033:0:8107:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607310.964034:0:8107:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607310.964036:0:8107:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607310.964037:0:8107:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607310.964039:0:8107:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607310.964041:0:8107:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607310.964043:0:8107:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607310.964044:0:8107:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789607310.964065:0:8107:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789607310.968823:0:8107:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607310.969061:0:8107:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607310.969323:0:8107:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607310.969484:0:8107:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607310.969716:0:8107:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607310.970065:0:8107:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789607310.971781:0:8107:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789607311.312414:0:8107:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789607311.312429:0:8107:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789607311.312478:0:8107:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789607311.312573:0:8107:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789607311.312593:0:8107:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789607311.312637:0:8107:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789607311.528911:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607312.545991:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607313.572646:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607313.644948:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149932544:0@lo:41: 00000100:00100000:2.0:1789607313.645153:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607313.645390:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932544 00000100:00100000:2.0:1789607313.645400:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932544 00000100:00100000:2.0:1789607313.645460:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607313.645472:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149932544:12345-0@lo:41: 00000004:00000024:2.0:1789607313.645524:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607313.645589:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149932544:12345-0@lo:41: Request processed in 119us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607313.645608:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607313.645758:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149932544:0@lo:41: 00000100:00100000:1.0:1789607314.147146:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607314.147187:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149932672:0@lo:41: 00000100:00100000:1.0:1789607314.147296:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607314.147567:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932672 00000100:00100000:0.0:1789607314.147579:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932672 00000100:00100000:0.0:1789607314.147647:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607314.147658:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149932672:12345-0@lo:41: 00000004:00000024:0.0:1789607314.147821:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607314.148055:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149932672:12345-0@lo:41: Request processed in 398us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607314.148063:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607314.154499:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149932672:0@lo:41: 00010000:00010000:2.0:1789607314.598312:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607315.621248:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607316.194849:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149932800:0@lo:400: 00000100:00100000:1.0:1789607316.194914:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149933056:0@lo:400: 00000100:00100000:1.0:1789607316.195270:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607316.195342:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149933568:0@lo:400: 00000100:00100000:1.0:1789607316.195371:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607316.195410:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607316.195417:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149933184:0@lo:400: 00000100:00100000:1.0:1789607316.195439:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607316.195503:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933056 00000100:00100000:1.0:1789607316.195677:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933056 00000100:00100000:1.0:1789607316.195742:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607316.195752:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149933056:12345-0@lo:400: 00000100:00100000:1.0:1789607316.195825:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149933056:12345-0@lo:400: Request processed in 74us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607316.195832:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607316.195887:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933568 00000100:00100000:1.0:1789607316.195891:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933568 00000100:00080000:0.0:1789607316.195930:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607316.195941:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933184 00000100:00100000:1.0:1789607316.195945:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933184 00000100:00100000:1.0:1789607316.195991:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607316.195999:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149933568:12345-0@lo:400: 00000100:00100000:1.0:1789607316.196031:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149933568:12345-0@lo:400: Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607316.196037:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607316.196060:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607316.196077:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149933184:12345-0@lo:400: 00000100:00100000:1.0:1789607316.196109:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149933184:12345-0@lo:400: Request processed in 34us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607316.196115:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789607316.198448:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416c000 x1876539149933184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607316.198471:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149933184:0@lo:400: 00000100:00100000:1.0:1789607316.198489:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149933056:0@lo:400: 00010000:00080000:1.0:1789607316.198501:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ea00 x1876539149933568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607316.198732:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149933568:0@lo:400: 00000100:00100000:3.0:1789607316.199105:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607316.199272:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149933312:0@lo:400: 00000100:00100000:3.0:1789607316.199341:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607316.199371:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607316.199381:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149932928:0@lo:400: 00000100:00100000:3.0:1789607316.199408:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607316.199428:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149933440:0@lo:400: 00000100:00100000:3.0:1789607316.199457:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607316.199508:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932928 00000100:00100000:3.0:1789607316.199519:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932928 00000100:00100000:3.0:1789607316.199571:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933440 00000100:00100000:3.0:1789607316.199574:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933440 00000100:00100000:3.0:1789607316.199608:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607316.199625:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149932928:12345-0@lo:400: 00000100:00100000:3.0:1789607316.199706:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149932928:12345-0@lo:400: Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607316.199714:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607316.199739:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789607316.199751:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416e300 x1876539149932928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607316.199761:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149933440:12345-0@lo:400: 00000100:00100000:1.0:1789607316.199771:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149932928:0@lo:400: 00000100:00100000:3.0:1789607316.199805:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149933440:12345-0@lo:400: Request processed in 57us (344us total) trans 0 rc 0/0 00010000:00080000:1.0:1789607316.199811:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ed80 x1876539149933440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607316.199816:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607316.199829:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149933440:0@lo:400: 00000100:00100000:3.0:1789607316.199847:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149932800 00000100:00100000:3.0:1789607316.199852:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149932800 00000100:00100000:3.0:1789607316.199908:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607316.199917:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:3468:x1876539149932800:12345-0@lo:400: 00000100:00100000:1.0:1789607316.199951:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933312 00000100:00100000:1.0:1789607316.199957:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933312 00000100:00100000:3.0:1789607316.199967:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:3468:x1876539149932800:12345-0@lo:400: Request processed in 50us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607316.199991:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607316.199995:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789607316.200004:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149933312:12345-0@lo:400: 00000100:00080000:3.0:1789607316.200032:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607316.200060:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149933312:12345-0@lo:400: Request processed in 59us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607316.200069:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607316.200137:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149933312:0@lo:400: 00000100:00100000:1.0:1789607316.200159:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149932800:0@lo:400: 00010000:00010000:3.0:1789607316.643989:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607317.666203:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607317.732260:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789607317.732272:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78f05a9800 from 30 10000000:01000000:1.0:1789607317.732280:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607317.732341:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.732355:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.732370:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607317.732401:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149933696:0@lo:101: 00000100:00100000:1.0:1789607317.732490:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.732558:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.732588:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933696 00000100:00100000:1.0:1789607317.732596:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933696 00000100:00100000:1.0:1789607317.732656:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789607317.732667:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:6466:x1876539149933696:12345-0@lo:101: 00010000:00010000:1.0:1789607317.732683:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607317.732698:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd3e8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.732726:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.732739:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 15 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.732758:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902052800, rc 0) 00000100:00100000:1.0:1789607317.732803:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149933696:12345-0@lo:101: Request processed in 136us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.732809:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789607317.732893:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149933696:0@lo:101: 00010000:00010000:1.0:1789607317.732911:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.732921:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607317.732984:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149933824:0@lo:501: 00000100:00100000:1.0:1789607317.733012:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.733030:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.733044:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933824 00000100:00100000:1.0:1789607317.733047:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933824 00000100:00100000:1.0:1789607317.733071:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789607317.733077:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149933824:12345-0@lo:501: 00000100:00100000:1.0:1789607317.739648:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149933824:12345-0@lo:501: Request processed in 6554us (6619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.739669:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789607317.740233:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149933824:0@lo:501: 00000100:00100000:3.0:1789607317.740315:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149933952:0@lo:503: 00000100:00100000:3.0:1789607317.740388:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607317.740423:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.740479:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149933952 00000100:00100000:1.0:1789607317.740488:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149933952 00000100:00100000:1.0:1789607317.740543:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607317.740554:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149933952:12345-0@lo:503: 00000100:00100000:1.0:1789607317.742512:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149933952:12345-0@lo:503: Request processed in 1949us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.742535:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789607317.742810:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149933952:0@lo:503: 00000100:00100000:3.0:1789607317.745423:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8444:1876539149934080:0@lo:502: 00000100:00100000:3.0:1789607317.745525:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607317.745573:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.745706:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934080 00000100:00100000:1.0:1789607317.745715:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934080 00000100:00100000:1.0:1789607317.745776:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789607317.745787:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8444:x1876539149934080:12345-0@lo:502: 00000100:00100000:1.0:1789607317.746516:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:8444:x1876539149934080:12345-0@lo:502: Request processed in 728us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.746525:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789607317.749327:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8444:1876539149934080:0@lo:502: 00000100:00100000:2.0:1789607317.749434:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8444:1876539149934208:0@lo:502: 00000100:00100000:2.0:1789607317.749525:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.749567:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.753339:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934208 00000100:00100000:1.0:1789607317.753359:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934208 00000100:00100000:1.0:1789607317.753426:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789607317.753439:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:8444:x1876539149934208:12345-0@lo:502: 00000100:00100000:1.0:1789607317.753803:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:8444:x1876539149934208:12345-0@lo:502: Request processed in 366us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.753811:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789607317.753909:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8444:1876539149934208:0@lo:502: 00000040:00080000:1.0:1789607317.753952:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789607317.754033:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789607317.754057:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607317.754069:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.754083:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607317.754095:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607317.754098:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78f05a9800 from 5 10000000:01000000:1.0:1789607317.754283:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607317.754325:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.754334:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.754344:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607317.754367:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934336:0@lo:101: 00000100:00100000:1.0:1789607317.754410:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.754457:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607317.756947:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934336 00000100:00100000:3.0:1789607317.756965:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934336 00000100:00100000:3.0:1789607317.757037:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607317.757049:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149934336:12345-0@lo:101: 00010000:00010000:3.0:1789607317.757072:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607317.757098:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd3f6 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.757133:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 16 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.757147:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 16 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.757157:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031000, rc 0) 00000100:00100000:3.0:1789607317.757259:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149934336:12345-0@lo:101: Request processed in 213us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607317.757274:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789607317.757446:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934336:0@lo:101: 00010000:00010000:1.0:1789607317.757468:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.757478:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607317.757554:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934464:0@lo:256: 00000100:00100000:1.0:1789607317.757597:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.757641:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607317.757690:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934464 00000100:00100000:3.0:1789607317.757696:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934464 00000100:00100000:3.0:1789607317.757729:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789607317.757736:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149934464:12345-0@lo:256: 20000000:01000000:3.0:1789607317.757752:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607317.757772:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607317.757775:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789607317.757856:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149934464:12345-0@lo:256: Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607317.757897:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789607317.757977:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934464:0@lo:256: 10000000:01000000:1.0:1789607317.758028:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607317.758036:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.758046:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607317.758061:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789607317.758064:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789607317.758067:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789607317.758091:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.758099:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.758108:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607317.758122:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934592:0@lo:101: 00000100:00100000:1.0:1789607317.758149:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.758179:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d850a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.758266:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934592 00000100:00100000:2.0:1789607317.758272:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934592 00000100:00100000:2.0:1789607317.758306:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607317.758314:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149934592:12345-0@lo:101: 00010000:00010000:2.0:1789607317.758323:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607317.758335:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd404 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.758353:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd404 expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.758362:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd404 expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.758369:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185000, rc 0) 00000100:00100000:2.0:1789607317.758401:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149934592:12345-0@lo:101: Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.758407:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607317.758472:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934592:0@lo:101: 00010000:00010000:1.0:1789607317.758483:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607317.758491:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607317.758542:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934720:0@lo:501: 00000100:00100000:1.0:1789607317.758567:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.758587:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d850a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607317.758666:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934720 00000100:00100000:3.0:1789607317.758671:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934720 00000100:00100000:3.0:1789607317.758700:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789607317.758707:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149934720:12345-0@lo:501: 00000100:00100000:3.0:1789607317.759047:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149934720:12345-0@lo:501: Request processed in 340us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607317.759055:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607317.759138:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934720:0@lo:501: 00000100:00100000:1.0:1789607317.759169:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934848:0@lo:503: 00000100:00100000:1.0:1789607317.759227:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.759256:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d850a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.759316:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934848 00000100:00100000:2.0:1789607317.759321:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934848 00000100:00100000:2.0:1789607317.759353:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789607317.759360:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149934848:12345-0@lo:503: 00000100:00100000:2.0:1789607317.759684:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149934848:12345-0@lo:503: Request processed in 324us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.759691:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607317.760039:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149934848:0@lo:503: 00000100:00100000:1.0:1789607317.764018:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8447:1876539149934976:0@lo:502: 00000100:00100000:1.0:1789607317.764140:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.764209:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d850ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607317.764338:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149934976 00000100:00100000:3.0:1789607317.764348:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149934976 00000100:00100000:3.0:1789607317.764409:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789607317.764420:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:8447:x1876539149934976:12345-0@lo:502: 00000100:00100000:3.0:1789607317.764803:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:8447:x1876539149934976:12345-0@lo:502: Request processed in 383us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607317.764812:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607317.765123:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8447:1876539149934976:0@lo:502: 00000020:01000000:1.0:1789607317.765160:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789607317.765169:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1789607317.765177:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607317.765180:0:8447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789607317.765185:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789607317.765201:0:8447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:1.0:1789607317.765231:0:8447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789607317.765235:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607317.765255:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d77c4193380) 00000020:00000080:1.0:1789607317.765284:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789607317.765291:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789607317.765388:0:8447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789607317.765395:0:8447:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789607317.765403:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbd419 00010000:00080000:1.0:1789607317.765439:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c3a5b800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607317.765737:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789607317.855224:0:8447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789607317.855253:0:8447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789607317.856364:0:8447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607317.856547:0:8447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607317.856603:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789607317.856679:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789607317.857500:0:8459:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607317.857506:0:8459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789607317.858169:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789607317.858185:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789607317.858236:0:8447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789607317.858308:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd420 00000100:00080000:0.0:1789607317.858321:0:8447:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607317.858335:0:8447:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d77c3a5b800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607317.858387:0:8447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78facbdc00 x1876539149935104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607317.858444:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539149935104:0@lo:8: 00000100:00100000:1.0:1789607317.858534:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607317.858614:0:8447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789607317.858688:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607317.858693:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607317.858695:0:8447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789607317.858698:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607317.858703:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607317.858705:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607317.858707:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607317.858709:0:8447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789607317.858738:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8447:1876539149935232:0@lo:502: 00000100:00100000:0.0:1789607317.858788:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.858816:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607317.858935:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935232 00000100:00100000:0.0:1789607317.858942:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935232 00000100:00100000:0.0:1789607317.858989:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607317.858999:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:8447:x1876539149935232:12345-0@lo:502: 00000100:00100000:0.0:1789607317.859348:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:8447:x1876539149935232:12345-0@lo:502: Request processed in 349us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.859356:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607317.859400:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539149935360:0@lo:400: 00000100:00100000:0.0:1789607317.859433:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.859457:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539149935872:0@lo:400: 00000100:00100000:0.0:1789607317.859481:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.859503:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607317.859508:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149935744:0@lo:400: 00000100:00100000:0.0:1789607317.859535:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.859567:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149935488:0@lo:400: 00000100:00100000:0.0:1789607317.859591:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.859609:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149936000:0@lo:400: 00000100:00100000:0.0:1789607317.859633:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.859652:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607317.859658:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539149935616:0@lo:400: 00000100:00100000:0.0:1789607317.859689:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.859730:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935360 00000100:00100000:0.0:1789607317.859735:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935360 00000100:00100000:0.0:1789607317.859759:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935872 00000100:00100000:0.0:1789607317.859762:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935872 00000100:00100000:0.0:1789607317.859775:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936000 00000100:00100000:0.0:1789607317.859783:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936000 00000100:00100000:0.0:1789607317.859799:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935616 00000100:00100000:0.0:1789607317.859802:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935616 00000100:00100000:0.0:1789607317.859816:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607317.859822:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539149935360:12345-0@lo:400: 00000100:00100000:0.0:1789607317.859886:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539149935360:12345-0@lo:400: Request processed in 63us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.859892:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607317.859906:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607317.859912:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539149935872:12345-0@lo:400: 00000100:00100000:0.0:1789607317.859940:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539149935872:12345-0@lo:400: Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.859946:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607317.859958:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607317.859964:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149936000:12345-0@lo:400: 00000100:00100000:0.0:1789607317.859996:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149936000:12345-0@lo:400: Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.860002:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607317.860013:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607317.860019:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539149935616:12345-0@lo:400: 00000100:00100000:0.0:1789607317.860043:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539149935616:12345-0@lo:400: Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.860048:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607317.860067:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935744 00000100:00100000:0.0:1789607317.860070:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935744 00000100:00100000:0.0:1789607317.860086:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935488 00000100:00100000:0.0:1789607317.860088:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935488 00000100:00100000:0.0:1789607317.860105:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607317.860110:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149935744:12345-0@lo:400: 00000100:00100000:0.0:1789607317.860137:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149935744:12345-0@lo:400: Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.860142:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607317.860150:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789607317.860155:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149935488:12345-0@lo:400: 00000100:00100000:0.0:1789607317.860175:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149935488:12345-0@lo:400: Request processed in 20us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607317.860181:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789607317.860240:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78facbfb80 x1876539149935616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607317.860255:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539149935616:0@lo:400: 00000100:00100000:0.0:1789607317.860264:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149935488:0@lo:400: 00010000:00080000:0.0:1789607317.860272:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78facbf480 x1876539149936000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607317.860280:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149936000:0@lo:400: 00000100:00100000:0.0:1789607317.860309:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149935744:0@lo:400: 00010000:00080000:0.0:1789607317.860318:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78facbdf80 x1876539149935360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607317.860326:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539149935360:0@lo:400: 00010000:00080000:0.0:1789607317.860335:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78facbd500 x1876539149935872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607317.860343:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539149935872:0@lo:400: 00000100:00100000:1.0:1789607317.860463:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149935104 00000100:00100000:1.0:1789607317.860468:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149935104 00000100:00100000:1.0:1789607317.860492:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607317.860498:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539149935104:12345-0@lo:8: 00010000:00080000:1.0:1789607317.860527:0:8112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1789607317.860560:0:8112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd427 00002000:00100000:1.0:1789607317.860604:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d77c3a5d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789607317.860609:0:8112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789607317.860613:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789607317.860763:0:8112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789607317.860947:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789607317.860979:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d77c3a5f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607317.861036:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539149935104:12345-0@lo:8: Request processed in 537us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.861042:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789607317.861078:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78facbdc00 x1876539149935104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607317.861088:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607317.861096:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789607317.861105:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789607317.861111:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789607317.861113:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c3a5b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789607317.861131:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789607317.861136:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539149935104:0@lo:8: 00000004:00080000:1.0:1789607317.861158:0:8459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789607317.861284:0:8459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 222818421782ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789607317.862971:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149936128:0@lo:700: 00000100:00100000:0.0:1789607317.863065:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607317.863103:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0ef6180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.864182:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8447:1876539149935232:0@lo:502: 00000020:01000000:2.0:1789607317.864250:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607317.864259:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607317.864261:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607317.864266:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1789607317.864520:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789607317.864543:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789607317.864561:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.864574:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607317.864585:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789607317.864589:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c75d7000 from 30 10000000:01000000:3.0:1789607317.864592:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607317.864631:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.864639:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.864649:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607317.864667:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149936256:0@lo:101: 00000100:00100000:3.0:1789607317.864730:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607317.864815:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa61fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.864850:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936128 00000100:00100000:1.0:1789607317.864874:0:8120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936128 00000100:00100000:1.0:1789607317.864938:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607317.864949:0:8120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8461:x1876539149936128:12345-0@lo:700: 00000100:00100000:1.0:1789607317.864994:0:8120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8120:1876539149936384:0@lo:700: 00000100:00100000:1.0:1789607317.865027:0:8120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607317.865051:0:8120:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607317.865072:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936384 00000100:00100000:1.0:1789607317.865075:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936384 00000100:00080000:3.0:1789607317.865096:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607317.865102:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607317.865108:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8120:x1876539149936384:12345-0@lo:700: 00000100:00100000:2.0:1789607317.865454:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936256 00000100:00100000:2.0:1789607317.865460:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936256 00000100:00100000:2.0:1789607317.865528:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789607317.865536:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149936256:12345-0@lo:101: 00010000:00010000:2.0:1789607317.865546:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607317.865563:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd42e expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.865588:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd42e expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.865599:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd42e expref: 18 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.865609:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184600, rc 0) 00000100:00100000:2.0:1789607317.865658:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149936256:12345-0@lo:101: Request processed in 123us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.865665:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789607317.865752:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149936256:0@lo:101: 00010000:00010000:2.0:1789607317.865768:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.865791:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607317.865854:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149936512:0@lo:501: 00000100:00100000:2.0:1789607317.865968:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.865995:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.866008:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936512 00000100:00100000:2.0:1789607317.866011:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936512 00000100:00100000:2.0:1789607317.866031:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607317.866037:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149936512:12345-0@lo:501: 00000100:00100000:2.0:1789607317.866277:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149936512:12345-0@lo:501: Request processed in 239us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.866285:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607317.866383:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149936512:0@lo:501: 00000100:00100000:2.0:1789607317.866409:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149936640:0@lo:503: 00000100:00100000:2.0:1789607317.866450:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.866478:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607317.866541:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936640 00000100:00100000:3.0:1789607317.866544:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936640 00000100:00100000:3.0:1789607317.866576:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789607317.866582:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149936640:12345-0@lo:503: 00000100:00100000:3.0:1789607317.866742:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149936640:12345-0@lo:503: Request processed in 159us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607317.866749:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789607317.866753:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149936640:0@lo:503: 00000100:00100000:2.0:1789607317.867056:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8463:1876539149936768:0@lo:502: 00000100:00100000:2.0:1789607317.867090:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.867109:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936768 00000100:00100000:2.0:1789607317.867113:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936768 00000100:00100000:2.0:1789607317.867132:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789607317.867138:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:8463:x1876539149936768:12345-0@lo:502: 00000100:00100000:2.0:1789607317.867381:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:8463:x1876539149936768:12345-0@lo:502: Request processed in 242us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.867388:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789607317.867424:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.867437:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8463:1876539149936768:0@lo:502: 00000100:00100000:2.0:1789607317.867479:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8463:1876539149936896:0@lo:502: 00000100:00100000:2.0:1789607317.867509:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.867527:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149936896 00000100:00100000:2.0:1789607317.867530:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149936896 00000100:00100000:2.0:1789607317.867548:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607317.867553:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8463:x1876539149936896:12345-0@lo:502: 00000100:00100000:2.0:1789607317.867665:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:8463:x1876539149936896:12345-0@lo:502: Request processed in 111us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.867672:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607317.867696:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.867706:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8463:1876539149936896:0@lo:502: 00000040:00080000:2.0:1789607317.867722:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789607317.867768:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789607317.867784:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607317.867793:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.867804:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607317.867814:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789607317.867822:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c75d7000 from 5 10000000:01000000:2.0:1789607317.867826:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607317.867851:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.867876:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.867958:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607317.867971:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937024:0@lo:101: 00000100:00100000:2.0:1789607317.867998:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.868018:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.868027:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937024 00000100:00100000:2.0:1789607317.868031:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937024 00000100:00100000:2.0:1789607317.868051:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607317.868057:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149937024:12345-0@lo:101: 00010000:00010000:2.0:1789607317.868066:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607317.868078:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd43c expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.868099:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd43c expref: 19 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.868110:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd43c expref: 19 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.868118:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:2.0:1789607317.868144:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149937024:12345-0@lo:101: Request processed in 86us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.868155:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607317.868182:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937024:0@lo:101: 00010000:00010000:2.0:1789607317.868205:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.868214:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607317.868258:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937152:0@lo:256: 00000100:00100000:2.0:1789607317.868287:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.868365:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.868377:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937152 00000100:00100000:2.0:1789607317.868380:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937152 00000100:00100000:2.0:1789607317.868399:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789607317.868405:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149937152:12345-0@lo:256: 20000000:01000000:2.0:1789607317.868417:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607317.868817:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607317.868821:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789607317.869000:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149937152:12345-0@lo:256: Request processed in 593us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.869007:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789607317.869539:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937152:0@lo:256: 10000000:01000000:3.0:1789607317.869602:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607317.869611:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.869621:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607317.869631:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789607317.869633:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789607317.869636:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789607317.869664:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.869672:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607317.869681:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607317.869697:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937280:0@lo:101: 00000100:00100000:3.0:1789607317.869732:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607317.869763:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa61f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.873043:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937280 00000100:00100000:2.0:1789607317.873058:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937280 00000100:00100000:2.0:1789607317.873124:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789607317.873137:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149937280:12345-0@lo:101: 00010000:00010000:2.0:1789607317.873159:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607317.873183:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd44a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.873235:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd44a expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.873249:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd44a expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.873261:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021dbe00, rc 0) 00000100:00100000:2.0:1789607317.874043:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149937280:12345-0@lo:101: Request processed in 907us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.874051:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789607317.874124:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937280:0@lo:101: 00010000:00010000:2.0:1789607317.874149:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607317.874185:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607317.874277:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937408:0@lo:501: 00000100:00100000:2.0:1789607317.874380:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.874414:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d3332240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.874431:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937408 00000100:00100000:2.0:1789607317.874435:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937408 00000100:00100000:2.0:1789607317.874460:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789607317.874466:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149937408:12345-0@lo:501: 00000100:00100000:2.0:1789607317.874656:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149937408:12345-0@lo:501: Request processed in 186us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.874668:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789607317.874712:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937408:0@lo:501: 00000100:00100000:2.0:1789607317.874737:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937536:0@lo:503: 00000100:00100000:2.0:1789607317.874776:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607317.874790:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d3332240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.874801:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937536 00000100:00100000:2.0:1789607317.874805:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937536 00000100:00100000:2.0:1789607317.874825:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789607317.874831:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149937536:12345-0@lo:503: 00000100:00100000:2.0:1789607317.875436:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149937536:12345-0@lo:503: Request processed in 601us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.875443:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789607317.875485:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149937536:0@lo:503: 00000100:00100000:3.0:1789607317.876452:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8465:1876539149937664:0@lo:502: 00000100:00100000:3.0:1789607317.876514:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607317.876553:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa61fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607317.877705:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937664 00000100:00100000:2.0:1789607317.877720:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937664 00000100:00100000:2.0:1789607317.877785:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789607317.877796:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:8465:x1876539149937664:12345-0@lo:502: 00000100:00100000:2.0:1789607317.882679:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:8465:x1876539149937664:12345-0@lo:502: Request processed in 4871us (6150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607317.882698:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789607317.882791:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8465:1876539149937664:0@lo:502: 00000020:01000000:2.0:1789607317.882837:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607317.882847:0:8465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789607317.882855:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607317.882857:0:8465:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789607317.882883:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607317.882887:0:8465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607317.882928:0:8465:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789607317.882932:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607317.882952:0:8465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d77c45519c0) 00000020:00000080:2.0:1789607317.882981:0:8465:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1789607317.882987:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607317.883083:0:8465:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789607317.883090:0:8465:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789607317.883097:0:8465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd45f 00010000:00080000:2.0:1789607317.883132:0:8465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c4446000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607317.884252:0:8465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1789607317.925053:0:6475:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789607317.932836:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8120:x1876539149936384:12345-0@lo:700: Request processed in 67715us (67796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607317.932854:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607317.932972:0:8120:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ed80 x1876539149936384/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789607333 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607317.932992:0:8120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8120:1876539149936384:0@lo:700: 40000000:02000000:1.0:1789607317.933343:0:8120:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000004:00080000:1.0:1789607317.947124:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:01000000:2.0:1789607318.027815:0:8465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789607318.027847:0:8465:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789607318.028691:0:8465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607318.029150:0:8465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607318.029224:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789607318.029372:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:0.0:1789607318.033496:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789607318.033775:0:8120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8461:x1876539149936128:12345-0@lo:700: Request processed in 168820us (170702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607318.033805:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1789607318.034113:0:8478:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607318.034119:0:8478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00010000:00080000:0.0:1789607318.034326:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7d500 x1876539149936128/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789607333 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.034345:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149936128:0@lo:700: 00000020:00000080:2.0:1789607318.048091:0:8465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607318.048113:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789607318.048162:0:8465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789607318.048215:0:8465:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd466 00000100:00080000:2.0:1789607318.048229:0:8465:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607318.048244:0:8465:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d77c4446000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607318.048293:0:8465:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f075c000 x1876539149937792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607318.048321:0:8465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789607318.048397:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607318.048402:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607318.048404:0:8465:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789607318.048408:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607318.048414:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607318.048422:0:8465:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607318.048428:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607318.048432:0:8465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789607318.048466:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8465:1876539149938688:0@lo:502: 00000100:00100000:0.0:1789607318.048473:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149937920:0@lo:400: 00000100:00100000:2.0:1789607318.049762:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.049832:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9cacd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607318.049883:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539149937792:0@lo:8: 00000100:00100000:2.0:1789607318.049931:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.049993:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938688 00000100:00100000:2.0:1789607318.050004:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938688 00000100:00100000:2.0:1789607318.050064:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789607318.050075:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:8465:x1876539149938688:12345-0@lo:502: 00000100:00100000:0.0:1789607318.050234:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607318.050262:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149938432:0@lo:400: 00000100:00100000:0.0:1789607318.050304:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607318.050337:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789607318.050345:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539149938304:0@lo:400: 00000100:00100000:0.0:1789607318.050373:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607318.050405:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149938944:0@lo:400: 00000100:00100000:0.0:1789607318.050433:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.050440:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:8465:x1876539149938688:12345-0@lo:502: Request processed in 366us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607318.050449:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789607318.050481:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149938048:0@lo:400: 00000100:00100000:2.0:1789607318.050487:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937920 00000100:00100000:2.0:1789607318.050491:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937920 00000100:00100000:2.0:1789607318.050510:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789607318.050511:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.050518:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:3469:x1876539149937920:12345-0@lo:400: 00000100:00100000:0.0:1789607318.050534:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539149938560:0@lo:400: 00000100:00100000:1.0:1789607318.050899:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938432 00000100:00100000:1.0:1789607318.050905:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938432 00000100:00100000:1.0:1789607318.050942:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607318.050951:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149938432:12345-0@lo:400: 00000100:00100000:2.0:1789607318.051233:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:3469:x1876539149937920:12345-0@lo:400: Request processed in 715us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607318.051241:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789607318.051290:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149937792 00000100:00100000:2.0:1789607318.051294:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149937792 00000100:00100000:2.0:1789607318.051315:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938944 00000100:00100000:2.0:1789607318.051318:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938944 00000100:00100000:2.0:1789607318.051337:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607318.051344:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149938944:12345-0@lo:400: 00000100:00100000:2.0:1789607318.051400:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149938944:12345-0@lo:400: Request processed in 56us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607318.051407:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607318.051421:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607318.051425:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539149937792:12345-0@lo:8: 00010000:00080000:2.0:1789607318.051457:0:8114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1789607318.051494:0:8114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd46d 00000100:00100000:0.0:1789607318.051501:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1789607318.051513:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d77c4442000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789607318.051518:0:8114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789607318.051520:0:8114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789607318.051533:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789607318.051542:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149938176:0@lo:400: 00002000:00080000:2.0:1789607318.051815:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789607318.051837:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607318.051844:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d77c4445800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607318.051852:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149938816:0@lo:400: 00000100:00100000:2.0:1789607318.051909:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539149937792:12345-0@lo:8: Request processed in 482us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607318.051917:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607318.051973:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:8465:1876539149938688:0@lo:502: 00000100:00100000:0.0:1789607318.051991:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789607318.052016:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607318.052024:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607318.052027:0:8465:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607318.052032:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1789607318.052045:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938304 00000100:00100000:0.0:1789607318.052050:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938304 00000100:00100000:0.0:1789607318.052077:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938048 00000100:00100000:0.0:1789607318.052079:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938048 00000100:00100000:0.0:1789607318.052090:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938560 00000100:00100000:0.0:1789607318.052092:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938560 00000100:00100000:0.0:1789607318.052123:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938816 00000100:00100000:0.0:1789607318.052126:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938816 00000100:00080000:3.0:1789607318.052129:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607318.052137:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607318.052145:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607318.052153:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539149938304:12345-0@lo:400: 00000100:00100000:0.0:1789607318.052261:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539149938304:12345-0@lo:400: Request processed in 109us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607318.052268:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607318.052287:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607318.052361:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149938048:12345-0@lo:400: 00000100:00100000:0.0:1789607318.052405:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149938048:12345-0@lo:400: Request processed in 111us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607318.052412:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607318.052428:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607318.052435:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539149938560:12345-0@lo:400: 00000100:00100000:0.0:1789607318.052469:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539149938560:12345-0@lo:400: Request processed in 36us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607318.052493:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607318.052507:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607318.052514:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149938816:12345-0@lo:400: 00000100:00100000:0.0:1789607318.052544:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149938816:12345-0@lo:400: Request processed in 31us (552us total) trans 0 rc 0/0 00010000:00080000:2.0:1789607318.054372:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f075c000 x1876539149937792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607318.054393:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607318.054405:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789607318.054416:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789607318.054423:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789607318.054436:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4446000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789607318.054460:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789607318.054468:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539149937792:0@lo:8: 00000020:01000000:2.0:1789607318.054509:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:0.0:1789607318.054529:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 10000000:01000000:2.0:1789607318.054542:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789607318.054553:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.054567:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607318.054579:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789607318.054582:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78e9ee99c0 from 1 10000000:01000000:2.0:1789607318.054585:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789607318.054586:0:6474:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789607318.054595:0:6474:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:2.0:1789607318.054628:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.054636:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789607318.055048:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7d180 x1876539149938816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.055062:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149938816:0@lo:400: 00010000:00080000:0.0:1789607318.055080:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7df80 x1876539149938048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.055090:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149938048:0@lo:400: 00010000:00080000:0.0:1789607318.055104:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7ea00 x1876539149938560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.055111:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539149938560:0@lo:400: 00010000:00080000:0.0:1789607318.055153:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7f800 x1876539149938304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.055165:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539149938304:0@lo:400: 00010000:00010000:2.0:1789607318.055342:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789607318.055360:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7dc00 x1876539149938944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607318.055368:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149939072:0@lo:101: 00000100:00100000:0.0:1789607318.055370:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149938944:0@lo:400: 00000100:00100000:0.0:1789607318.055389:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149937920:0@lo:400: 00000100:00100000:2.0:1789607318.055449:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.055501:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0c219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607318.055525:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939072 00000100:00100000:2.0:1789607318.055533:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939072 00000100:00100000:2.0:1789607318.055586:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607318.055597:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149939072:12345-0@lo:101: 00010000:00010000:2.0:1789607318.055626:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607318.055714:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd474 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.055750:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd474 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.055763:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd474 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.055773:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021db600, rc 0) 00000100:00100000:2.0:1789607318.055820:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149939072:12345-0@lo:101: Request processed in 225us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607318.055828:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607318.055895:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149939072:0@lo:101: 00010000:00010000:2.0:1789607318.055913:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.055923:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607318.055992:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149939200:0@lo:501: 00000100:00100000:2.0:1789607318.056024:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.056048:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0c219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607318.056064:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939200 00000100:00100000:2.0:1789607318.056068:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939200 00000100:00100000:2.0:1789607318.056094:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607318.056103:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149939200:12345-0@lo:501: 00000100:00100000:2.0:1789607318.057060:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149939200:12345-0@lo:501: Request processed in 954us (1031us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607318.057071:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607318.057137:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149939200:0@lo:501: 00000100:00100000:0.0:1789607318.058349:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149938432:12345-0@lo:400: Request processed in 7391us (8046us total) trans 0 rc 0/0 00000004:00080000:1.0:1789607318.058364:0:8478:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789607318.058364:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607318.058428:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149938432:0@lo:400: 00000100:00100000:0.0:1789607318.058473:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149938176 00000100:00100000:0.0:1789607318.058482:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149938176 00000100:00100000:0.0:1789607318.058515:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789607318.058522:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149938176:12345-0@lo:400: 00000004:00080000:1.0:1789607318.058528:0:8478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 223015665764ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789607318.058597:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149938176:12345-0@lo:400: Request processed in 75us (6759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607318.058603:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789607318.058633:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149938176:0@lo:400: 10000000:01000000:2.0:1789607318.058753:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607318.058767:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607318.058779:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607318.124281:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789607318.125591:0:8461:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789607318.125624:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149939456:0@lo:7: 00000100:00100000:1.0:1789607318.125711:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607318.125764:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607318.125785:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149939328:0@lo:13: 00000100:00100000:1.0:1789607318.125812:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607318.125854:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939456 00000100:00100000:1.0:1789607318.125883:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939456 00000100:00100000:1.0:1789607318.125940:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607318.125950:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8461:x1876539149939456:12345-0@lo:7: 00002000:00080000:1.0:1789607318.140728:0:8114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789607318.140739:0:8114:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789607318.140900:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8461:x1876539149939456:12345-0@lo:7: Request processed in 14943us (15181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607318.140914:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789607318.140991:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ea00 x1876539149939456/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607318.141027:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149939456:0@lo:7: 00000004:00080000:1.0:1789607318.141045:0:8461:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789607318.141098:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149939584:0@lo:5: 00000100:00100000:1.0:1789607318.141138:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607318.142401:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607318.142440:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939328 00000100:00100000:1.0:1789607318.142451:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939328 00000100:00100000:1.0:1789607318.142509:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607318.142520:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149939328:12345-0@lo:13: 00002000:00000024:1.0:1789607318.143468:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789607318.143593:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149939328:12345-0@lo:13: Request processed in 1072us (17777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607318.143603:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607318.143820:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939584 00000100:00100000:1.0:1789607318.143827:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939584 00000100:00100000:1.0:1789607318.143855:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607318.143894:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8461:x1876539149939584:12345-0@lo:5: 00002000:00080000:1.0:1789607318.143924:0:8113:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789607318.143957:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8461:x1876539149939584:12345-0@lo:5: Request processed in 67us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607318.143963:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789607318.144031:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ea00 x1876539149939584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607318.144048:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149939584:0@lo:5: 00000004:00080000:1.0:1789607318.144062:0:8461:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00010000:00080000:0.0:1789607318.144902:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ed80 x1876539149939328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.144924:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149939328:0@lo:13: 00000004:00080000:1.0:1789607318.186249:0:8479:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789607318.186360:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149939840:0@lo:7: 00000100:00100000:1.0:1789607318.186475:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607318.186517:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607318.186560:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939840 00000100:00100000:1.0:1789607318.186569:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939840 00000100:00100000:1.0:1789607318.186651:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607318.186661:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8479:x1876539149939840:12345-0@lo:7: 00000100:00100000:0.0:1789607318.187363:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149939712:0@lo:13: 00000100:00100000:0.0:1789607318.187418:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607318.187478:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939712 00000100:00100000:0.0:1789607318.187484:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939712 00000100:00100000:0.0:1789607318.187528:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607318.187535:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3470:x1876539149939712:12345-0@lo:13: 00002000:00000024:0.0:1789607318.187554:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789607318.187602:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3470:x1876539149939712:12345-0@lo:13: Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607318.187609:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789607318.187766:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ea00 x1876539149939712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.187789:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149939712:0@lo:13: 00000100:00080000:3.0:1789607318.188067:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789607318.203395:0:8113:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789607318.203412:0:8113:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789607318.203542:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8479:x1876539149939840:12345-0@lo:7: Request processed in 16875us (17061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607318.203559:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789607318.203957:0:8479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416f100 x1876539149939840/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607318.203978:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149939840:0@lo:7: 00000004:00080000:1.0:1789607318.203997:0:8479:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789607318.204050:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149939968:0@lo:5: 00000100:00100000:1.0:1789607318.204096:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607318.204140:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607318.204163:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149939968 00000100:00100000:1.0:1789607318.204171:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149939968 00000100:00100000:1.0:1789607318.204228:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607318.204241:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8479:x1876539149939968:12345-0@lo:5: 00002000:00080000:1.0:1789607318.204274:0:8114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789607318.204279:0:8114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789607318.204577:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8479:x1876539149939968:12345-0@lo:5: Request processed in 338us (481us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789607318.204585:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789607318.204617:0:8479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416f100 x1876539149939968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607318.204648:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149939968:0@lo:5: 00000004:00080000:1.0:1789607318.204658:0:8479:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789607318.204688:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149940096:0@lo:700: 00000100:00100000:1.0:1789607318.204713:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607318.204736:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607318.204965:0:8121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940096 00000100:00100000:3.0:1789607318.204978:0:8121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940096 00000100:00100000:3.0:1789607318.205010:0:8121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607318.205019:0:8121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8479:x1876539149940096:12345-0@lo:700: 00000001:02000400:0.0:1789607318.240473:0:8495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:0.0:1789607318.299366:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789607318.299385:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789607318.299525:0:8121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8479:x1876539149940096:12345-0@lo:700: Request processed in 94504us (94806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607318.299537:0:8121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789607318.299980:0:8479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416e680 x1876539149940096/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789607334 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607318.299991:0:8479:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789607318.300006:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149940096:0@lo:700: 00000004:02000040:3.0:1789607318.373310:0:8479:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789607318.388853:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149940224:0@lo:5: 00000100:00100000:2.0:1789607318.388972:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.389042:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607318.389149:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940224 00000100:00100000:1.0:1789607318.389160:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940224 00000100:00100000:1.0:1789607318.389253:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607318.389265:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8479:x1876539149940224:12345-0@lo:5: 00002000:00080000:1.0:1789607318.400978:0:8113:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789607318.401008:0:8113:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789607318.412963:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8479:x1876539149940224:12345-0@lo:5: Request processed in 23686us (23976us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789607318.412982:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789607318.414597:0:8479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f075c000 x1876539149940224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607334 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607318.414624:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8479:1876539149940224:0@lo:5: 00000004:00080000:3.0:1789607318.414647:0:8479:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1789607318.698588:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607318.755065:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149940352:0@lo:41: 00000100:00100000:0.0:1789607318.755193:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607318.755547:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940352 00000100:00100000:2.0:1789607318.755558:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940352 00000100:00100000:2.0:1789607318.755623:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607318.755634:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149940352:12345-0@lo:41: 00000004:00000024:2.0:1789607318.755690:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607318.755758:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149940352:12345-0@lo:41: Request processed in 125us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607318.755766:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607318.755849:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149940352:0@lo:41: 00000100:00100000:0.0:1789607319.268638:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607319.268660:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149940480:0@lo:41: 00000100:00100000:0.0:1789607319.268723:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607319.273208:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940480 00000100:00100000:1.0:1789607319.273222:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940480 00000100:00100000:1.0:1789607319.273285:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607319.273295:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149940480:12345-0@lo:41: 00000004:00000024:1.0:1789607319.273334:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607319.273438:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149940480:12345-0@lo:41: Request processed in 145us (4715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607319.273445:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607319.273513:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149940480:0@lo:41: 00010000:00010000:3.0:1789607319.713954:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607320.738215:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607321.766598:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607322.786141:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607323.366631:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149940608:0@lo:13: 00000100:00100000:3.0:1789607323.366719:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.367460:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149940864:0@lo:5: 00000100:00100000:1.0:1789607323.367501:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.367534:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607323.367561:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149940736:0@lo:13: 00000100:00100000:1.0:1789607323.367581:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607323.371642:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940608 00000100:00100000:0.0:1789607323.371663:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940608 00000100:00100000:0.0:1789607323.371741:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940736 00000100:00100000:0.0:1789607323.371745:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940736 00000100:00100000:0.0:1789607323.371768:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607323.371781:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539149940608:12345-0@lo:13: 00002000:00000024:0.0:1789607323.371830:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607323.371963:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539149940608:12345-0@lo:13: Request processed in 185us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607323.371971:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607323.371991:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607323.372017:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149940736:12345-0@lo:13: 00002000:00000024:0.0:1789607323.372028:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607323.372067:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149940736:12345-0@lo:13: Request processed in 52us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607323.372073:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607323.372095:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940864 00000100:00100000:0.0:1789607323.372099:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940864 00000100:00100000:0.0:1789607323.372130:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607323.372136:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8461:x1876539149940864:12345-0@lo:5: 00002000:00080000:0.0:1789607323.372181:0:8112:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00080000:3.0:1789607323.373438:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607323.373497:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0f800 x1876539149940608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607323.373525:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149940608:0@lo:13: 00010000:00080000:0.0:1789607323.394280:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416ed80 x1876539149940736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607323.394316:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149940736:0@lo:13: 00000100:00100000:1.0:1789607323.424965:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149940992:0@lo:400: 00000100:00100000:1.0:1789607323.425053:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425096:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149941504:0@lo:400: 00000100:00100000:1.0:1789607323.425138:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425177:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607323.425182:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149941376:0@lo:400: 00000100:00100000:1.0:1789607323.425201:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425225:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149941248:0@lo:400: 00000100:00100000:1.0:1789607323.425240:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425250:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149941760:0@lo:400: 00000100:00100000:1.0:1789607323.425262:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425272:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607323.425275:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149941120:0@lo:400: 00000100:00100000:1.0:1789607323.425288:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425297:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149941632:0@lo:400: 00000100:00100000:1.0:1789607323.425310:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.425330:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149940992 00000100:00100000:1.0:1789607323.425347:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149940992 00000100:00100000:1.0:1789607323.425395:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789607323.425408:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:3471:x1876539149940992:12345-0@lo:400: 00000100:00100000:1.0:1789607323.425452:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:3471:x1876539149940992:12345-0@lo:400: Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607323.425457:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789607323.425487:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941504 00000100:00100000:1.0:1789607323.425490:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941504 00000100:00100000:1.0:1789607323.425505:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941248 00000100:00100000:1.0:1789607323.425506:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941248 00000100:00100000:1.0:1789607323.425515:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607323.425519:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149941504:12345-0@lo:400: 00000100:00100000:1.0:1789607323.425542:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149941504:12345-0@lo:400: Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607323.425556:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607323.425564:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789607323.425567:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149941248:12345-0@lo:400: 00000100:00100000:1.0:1789607323.425587:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149941248:12345-0@lo:400: Request processed in 20us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607323.425591:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789607323.425626:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149940992:0@lo:400: 00000100:00100000:1.0:1789607323.425641:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149941504:0@lo:400: 00000100:00100000:1.0:1789607323.425673:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149941248:0@lo:400: 00000100:00100000:0.0:1789607323.427657:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941376 00000100:00100000:0.0:1789607323.427677:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941376 00000100:00100000:1.0:1789607323.429953:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941760 00000100:00100000:0.0:1789607323.429963:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941120 00000100:00100000:1.0:1789607323.429971:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941760 00000100:00100000:0.0:1789607323.429972:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941120 00000100:00100000:0.0:1789607323.429992:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941632 00000100:00100000:0.0:1789607323.429995:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941632 00000100:00100000:1.0:1789607323.430029:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607323.430041:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149941376:12345-0@lo:400: 00000100:00100000:1.0:1789607323.430200:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149941376:12345-0@lo:400: Request processed in 153us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607323.431063:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607323.431074:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607323.431087:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149941120:12345-0@lo:400: 00000100:00100000:1.0:1789607323.431116:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607323.431126:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149941760:12345-0@lo:400: 00000100:00100000:0.0:1789607323.431227:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149941120:12345-0@lo:400: Request processed in 152us (5935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607323.431229:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149941760:12345-0@lo:400: Request processed in 104us (5963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607323.431243:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607323.431250:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789607323.431269:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607323.431279:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149941632:12345-0@lo:400: 00000100:00080000:1.0:1789607323.431303:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607323.431309:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607323.431336:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149941632:12345-0@lo:400: Request processed in 50us (6014us total) trans 0 rc 0/0 00010000:00080000:1.0:1789607323.431352:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f7573800 x1876539149941376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607323.431355:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607323.431373:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149941376:0@lo:400: 00010000:00080000:0.0:1789607323.434734:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f7570e00 x1876539149941120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607323.434759:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149941120:0@lo:400: 00010000:00080000:0.0:1789607323.434780:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f7572d80 x1876539149941632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607323.434790:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149941632:0@lo:400: 00010000:00080000:0.0:1789607323.434806:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f7571f80 x1876539149941760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607323.434815:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149941760:0@lo:400: 00000100:00100000:1.0:1789607323.436480:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8461:x1876539149940864:12345-0@lo:5: Request processed in 64335us (68969us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789607323.436491:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789607323.436546:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77c416d500 x1876539149940864/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607323.436561:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8461:1876539149940864:0@lo:5: 00000004:00080000:1.0:1789607323.436576:0:8461:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789607323.436618:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8461:1876539149941888:0@lo:900: 00000100:00100000:1.0:1789607323.436647:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.436665:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607323.436687:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149941888 00000100:00100000:1.0:1789607323.436693:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149941888 00000100:00100000:1.0:1789607323.436730:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607323.436736:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8461:x1876539149941888:12345-0@lo:900: 00000100:00100000:1.0:1789607323.436783:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8461:x1876539149941888:12345-0@lo:900: Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607323.436788:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607323.436810:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fcd80e00 x1876539149941888/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607323.436817:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8461:1876539149941888:0@lo:900: 00000001:00080000:0.0:1789607323.512405:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789607323.811030:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789607323.818931:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789607323.876421:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607323.876458:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149942016:0@lo:41: 00000100:00100000:1.0:1789607323.876551:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607323.876638:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942016 00000100:00100000:1.0:1789607323.876647:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942016 00000100:00100000:1.0:1789607323.876700:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607323.876709:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149942016:12345-0@lo:41: 00000004:00000024:1.0:1789607323.876759:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607323.876813:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149942016:12345-0@lo:41: Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607323.876820:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607323.876892:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149942016:0@lo:41: 00000100:00100000:1.0:1789607324.388553:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149942144:0@lo:41: 00000100:00100000:1.0:1789607324.388648:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607324.388729:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942144 00000100:00100000:1.0:1789607324.388739:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942144 00000100:00100000:1.0:1789607324.388783:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607324.388792:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149942144:12345-0@lo:41: 00000004:00000024:1.0:1789607324.388838:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607324.388925:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149942144:12345-0@lo:41: Request processed in 133us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607324.388932:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607324.388982:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149942144:0@lo:41: 00010000:00010000:3.0:1789607324.837223:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607325.859081:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607326.884198:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607327.909427:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607328.485142:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149942272:0@lo:400: 00000100:00100000:3.0:1789607328.485207:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485248:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149942784:0@lo:400: 00000100:00100000:3.0:1789607328.485273:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485294:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149943296:0@lo:400: 00000100:00100000:3.0:1789607328.485331:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485354:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789607328.485361:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149942400:0@lo:400: 00000100:00100000:3.0:1789607328.485385:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485403:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149942912:0@lo:400: 00000100:00100000:3.0:1789607328.485422:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485438:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149943424:0@lo:13: 00000100:00100000:3.0:1789607328.485469:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485499:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149942528:0@lo:400: 00000100:00100000:3.0:1789607328.485535:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485553:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149943040:0@lo:400: 00000100:00100000:3.0:1789607328.485578:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485594:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789607328.485599:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149942656:0@lo:400: 00000100:00100000:3.0:1789607328.485615:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485628:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149943168:0@lo:400: 00000100:00100000:3.0:1789607328.485658:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.485687:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942784 00000100:00100000:3.0:1789607328.485693:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942784 00000100:00100000:3.0:1789607328.485727:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942528 00000100:00100000:3.0:1789607328.485729:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942528 00000100:00100000:3.0:1789607328.485742:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607328.485750:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149942784:12345-0@lo:400: 00000100:00100000:3.0:1789607328.485808:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149942784:12345-0@lo:400: Request processed in 58us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.485814:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607328.485838:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607328.485843:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149942528:12345-0@lo:400: 00000100:00100000:3.0:1789607328.485893:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149942528:12345-0@lo:400: Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.485899:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607328.485919:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943296 00000100:00100000:3.0:1789607328.485923:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943296 00000100:00100000:3.0:1789607328.485955:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943168 00000100:00100000:3.0:1789607328.485958:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943168 00000100:00100000:3.0:1789607328.485971:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607328.485978:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149943296:12345-0@lo:400: 00000100:00100000:3.0:1789607328.486008:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149943296:12345-0@lo:400: Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486014:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607328.486025:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607328.486031:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149943168:12345-0@lo:400: 00000100:00100000:3.0:1789607328.486055:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149943168:12345-0@lo:400: Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486061:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607328.486077:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942400 00000100:00100000:3.0:1789607328.486081:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942400 00000100:00100000:3.0:1789607328.486097:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942912 00000100:00100000:3.0:1789607328.486099:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942912 00000100:00100000:3.0:1789607328.486121:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943040 00000100:00100000:3.0:1789607328.486124:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943040 00000100:00100000:3.0:1789607328.486138:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942656 00000100:00100000:3.0:1789607328.486140:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942656 00000100:00100000:3.0:1789607328.486150:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607328.486155:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149942400:12345-0@lo:400: 00000100:00100000:3.0:1789607328.486189:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149942400:12345-0@lo:400: Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486195:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607328.486206:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607328.486212:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149942912:12345-0@lo:400: 00000100:00100000:3.0:1789607328.486238:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149942912:12345-0@lo:400: Request processed in 27us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486243:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607328.486254:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607328.486259:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149943040:12345-0@lo:400: 00000100:00100000:3.0:1789607328.486282:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149943040:12345-0@lo:400: Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486287:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607328.486297:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607328.486303:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149942656:12345-0@lo:400: 00000100:00100000:3.0:1789607328.486327:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149942656:12345-0@lo:400: Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486332:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607328.486354:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943424 00000100:00100000:3.0:1789607328.486357:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943424 00000100:00100000:3.0:1789607328.486376:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607328.486381:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149943424:12345-0@lo:13: 00002000:00000024:3.0:1789607328.486402:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607328.486431:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149943424:12345-0@lo:13: Request processed in 50us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.486436:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789607328.486486:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0ea00 x1876539149942400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486499:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149942400:0@lo:400: 00010000:00080000:3.0:1789607328.486509:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0ca80 x1876539149942912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486517:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149942912:0@lo:400: 00010000:00080000:3.0:1789607328.486527:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0e300 x1876539149943424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486533:0:3468:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789607328.486551:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149943424:0@lo:13: 00000100:00100000:3.0:1789607328.486562:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149942784:0@lo:400: 00010000:00080000:3.0:1789607328.486571:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0df80 x1876539149943296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486578:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149943296:0@lo:400: 00010000:00080000:3.0:1789607328.486605:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0dc00 x1876539149942656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486613:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149942656:0@lo:400: 00010000:00080000:3.0:1789607328.486620:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0c000 x1876539149943168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486625:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789607328.486633:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149943168:0@lo:400: 00000100:00100000:3.0:1789607328.486640:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149942528:0@lo:400: 00010000:00080000:3.0:1789607328.486658:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fff0f100 x1876539149943040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.486666:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149943040:0@lo:400: 00000100:00080000:3.0:1789607328.486683:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607328.486687:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607328.486689:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607328.489662:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149942272 00000100:00100000:0.0:1789607328.489676:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149942272 00000100:00100000:0.0:1789607328.489722:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789607328.489733:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:3468:x1876539149942272:12345-0@lo:400: 00000100:00100000:0.0:1789607328.489814:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:3468:x1876539149942272:12345-0@lo:400: Request processed in 83us (4607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607328.489821:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789607328.492692:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149942272:0@lo:400: 00000100:00100000:3.0:1789607328.492732:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149943552:0@lo:13: 00000100:00100000:3.0:1789607328.492789:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607328.492833:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943552 00000100:00100000:3.0:1789607328.492839:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943552 00000100:00100000:3.0:1789607328.503641:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607328.503661:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149943552:12345-0@lo:13: 00002000:00000024:3.0:1789607328.503689:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607328.503782:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149943552:12345-0@lo:13: Request processed in 129us (10992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607328.503789:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789607328.503842:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7ea00 x1876539149943552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607328.503879:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149943552:0@lo:13: 00010000:00010000:3.0:1789607328.933254:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607328.994161:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607328.994187:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149943680:0@lo:41: 00000100:00100000:0.0:1789607328.994262:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607328.994409:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943680 00000100:00100000:1.0:1789607328.994418:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943680 00000100:00100000:1.0:1789607328.994461:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607328.994471:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149943680:12345-0@lo:41: 00000004:00000024:1.0:1789607328.994508:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607329.002977:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149943680:12345-0@lo:41: Request processed in 8422us (8629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607329.002991:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607329.003162:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149943680:0@lo:41: 00000100:00100000:1.0:1789607329.513796:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149943808:0@lo:41: 00000100:00100000:1.0:1789607329.513881:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607329.513960:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943808 00000100:00100000:1.0:1789607329.513967:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943808 00000100:00100000:1.0:1789607329.514005:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607329.514012:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149943808:12345-0@lo:41: 00000004:00000024:1.0:1789607329.514046:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607329.514084:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149943808:12345-0@lo:41: Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607329.514090:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607329.514701:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149943808:0@lo:41: 00010000:00010000:1.0:1789607329.966291:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607330.980174:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607332.004323:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607332.107555:0:9058:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607332.107559:0:9058:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789607332.107721:0:9058:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d78f77e7800 00000020:01000004:2.0:1789607332.107740:0:9058:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789607332.107756:0:9058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607332.107770:0:9058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d77c4553380) 00000020:00000080:2.0:1789607332.107786:0:9058:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789607332.198658:0:9058:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789607332.200460:0:9058:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789607332.256568:0:9058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789607332.290553:0:9058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789607332.290616:0:9058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789607332.290676:0:9058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789607332.290717:0:9058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789607332.291096:0:9058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789607332.291120:0:9058:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607332.291130:0:9058:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa26202d240fbd489 00000020:01000004:3.0:1789607332.291138:0:9058:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789607332.291159:0:9058:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789607332.291162:0:9058:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789607332.291178:0:9058:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789607332.291198:0:9058:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789607332.291203:0:9058:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789607332.343575:0:9058:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789607332.343611:0:9058:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789607332.343616:0:9058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789607332.343618:0:9058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607332.343619:0:9058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607332.343621:0:9058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607332.343622:0:9058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607332.343623:0:9058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607332.343625:0:9058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607332.343626:0:9058:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607332.343627:0:9058:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607332.343629:0:9058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607332.343630:0:9058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607332.343635:0:9058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789607332.343636:0:9058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789607332.343638:0:9058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607332.343639:0:9058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607332.343640:0:9058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607332.343641:0:9058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607332.343642:0:9058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607332.343643:0:9058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607332.343644:0:9058:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607332.343645:0:9058:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607332.343646:0:9058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607332.343647:0:9058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607332.343672:0:9058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789607332.343691:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149943936:0@lo:253: 00000100:00100000:0.0:1789607332.343760:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.343851:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607332.343964:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149943936 00000100:00100000:1.0:1789607332.343978:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149943936 00000100:00100000:1.0:1789607332.344057:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789607332.344067:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:9058:x1876539149943936:12345-0@lo:253: 20000000:01000000:1.0:1789607332.344110:0:6464:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789607332.344114:0:6464:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789607332.344118:0:6464:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789607332.344122:0:6464:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789607332.345292:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607332.345548:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789607332.345563:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789607332.345600:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789607332.345607:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789607332.345638:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789607332.345686:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789607332.346462:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789607332.346487:0:6464:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1789607332.346489:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1789607332.346526:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789607332.346534:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789607332.346601:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789607332.346609:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1789607332.346658:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789607332.346669:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789607332.346702:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789607332.346749:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789607332.347326:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789607332.347346:0:6464:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1789607332.347348:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1789607332.347401:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789607332.347411:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789607332.347457:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789607332.347472:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1789607332.347519:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789607332.347531:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789607332.347565:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789607332.347611:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789607332.348486:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789607332.348502:0:6464:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1789607332.348504:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1789607332.348539:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789607332.348547:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789607332.348576:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789607332.348584:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1789607332.348613:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789607332.348621:0:6464:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789607332.348678:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789607332.348718:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789607332.348734:0:6464:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789607332.348737:0:6464:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789607332.348742:0:6464:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789607332.348744:0:6464:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789607332.348746:0:6464:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789607332.348758:0:6464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789607332.348760:0:6464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789607332.348794:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789607332.348797:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607332.349963:0:9059:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607332.350058:0:9059:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607332.350104:0:9059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789607332.350474:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789607332.350518:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789607332.350586:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789607332.350599:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789607332.350601:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607332.351143:0:9060:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607332.351202:0:9060:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607332.351258:0:9060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789607332.351515:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789607332.351551:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789607332.351614:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789607332.351625:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789607332.351627:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607332.352095:0:9061:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607332.352138:0:9061:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607332.352316:0:9061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789607332.352541:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789607332.352594:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789607332.352628:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789607332.352638:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789607332.352640:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607332.353117:0:9062:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607332.353160:0:9062:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607332.353215:0:9062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789607332.353473:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789607332.353511:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789607332.353574:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789607332.353586:0:6464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789607332.353588:0:6464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789607332.353977:0:9063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789607332.354167:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789607332.354201:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789607332.354254:0:6464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1789607332.354274:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789607332.354292:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354309:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd37f expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354317:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354324:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354529:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd404 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354536:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd42e expref: 21 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354550:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354557:0:6464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd474 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354564:0:6464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354601:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd474 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354615:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd474 expref: 21 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.354629:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944064:0@lo:104: 00000100:00100000:1.0:1789607332.354692:0:6464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607332.354749:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354757:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.354765:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944192:0@lo:104: 00000100:00100000:1.0:1789607332.354787:0:6464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607332.354890:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd42e expref: 21 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.354897:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd42e expref: 21 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.354911:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944320:0@lo:104: 00000100:00100000:1.0:1789607332.354931:0:6464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607332.355054:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd404 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.355061:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd404 expref: 21 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.355068:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944448:0@lo:104: 00000100:00100000:1.0:1789607332.355097:0:6464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.355122:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944064 00000100:00100000:0.0:1789607332.355128:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944064 00000100:00100000:2.0:1789607332.355223:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944192 00000100:00100000:2.0:1789607332.355226:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944192 00000100:00100000:2.0:1789607332.355237:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944320 00000100:00100000:2.0:1789607332.355239:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944320 00000100:00100000:2.0:1789607332.355251:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607332.355259:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:6464:x1876539149944064:12345-0@lo:104: 00010000:00010000:2.0:1789607332.355271:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.355408:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607332.355415:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:6464:x1876539149944064:12345-0@lo:104: Request processed in 157us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.355432:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607332.355448:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789607332.355454:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6464:x1876539149944192:12345-0@lo:104: 00010000:00010000:2.0:1789607332.355462:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.355528:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.355537:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.355545:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944576:0@lo:104: 00000100:00100000:1.0:1789607332.355565:0:6464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607332.355583:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.355591:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.355598:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944704:0@lo:104: 00000100:00100000:1.0:1789607332.355618:0:6464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607332.355634:0:6464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd37f expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.355652:0:6464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd37f expref: 21 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.355661:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7573800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944832:0@lo:104: 00000100:00100000:1.0:1789607332.355680:0:6464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9daae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607332.355697:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944064:0@lo:104: 00000100:00100000:1.0:1789607332.355705:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944192:0@lo:104: 00010000:00010000:0.0:1789607332.355752:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607332.355759:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355766:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79021da600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607332.355778:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355787:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607332.355794:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607332.355800:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789607332.355853:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607332.355891:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607332.355896:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355904:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789607332.355906:0:6453:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789607332.355914:0:6453:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789607332.355925:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355932:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d79021da600/0xa26202d240fbd474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd47b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355946:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607332.355950:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355956:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031c00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607332.355959:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.355965:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607332.355982:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607332.355987:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607332.356074:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789607332.356078:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944448 00000100:00100000:3.0:1789607332.356092:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944448 00000100:00100000:2.0:1789607332.356092:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6464:x1876539149944192:12345-0@lo:104: Request processed in 627us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.356102:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789607332.356116:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944576 00000100:00100000:2.0:1789607332.356120:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944576 00000100:00100000:1.0:1789607332.356324:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149944960:0@lo:103: 00000100:00100000:1.0:1789607332.356352:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.356392:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944960 00000100:00100000:1.0:1789607332.356396:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944960 00010000:00010000:1.0:1789607332.356413:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd474 expref: 22 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.356436:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607332.356443:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+22:3469:x1876539149944960:12345-0@lo:103: 00010000:00010000:1.0:1789607332.356453:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.356458:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd474 expref: 22 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.356468:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd474 expref: 22 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.356480:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021db600/0xa26202d240fbd47b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd474 expref: 22 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.356493:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607332.356526:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+21:3469:x1876539149944960:12345-0@lo:103: Request processed in 84us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.356533:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607332.356562:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149944960:0@lo:103: 00010000:00010000:0.0:1789607332.356654:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.356661:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607332.356676:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.356683:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd44a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd451 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.356694:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607332.356696:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607332.356698:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607332.356702:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944704 00000100:00100000:3.0:1789607332.356707:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944704 00000100:00100000:0.0:1789607332.356709:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149945088:0@lo:103: 00000100:00100000:0.0:1789607332.356743:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.356777:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945088 00000100:00100000:0.0:1789607332.356781:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945088 00010000:00010000:0.0:1789607332.356794:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607332.356814:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607332.356819:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+21:3470:x1876539149945088:12345-0@lo:103: 00010000:00010000:0.0:1789607332.356826:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607332.356830:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.356844:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.356854:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd44a expref: 21 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.356879:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607332.356907:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+20:3470:x1876539149945088:12345-0@lo:103: Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.356913:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607332.356940:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149945088:0@lo:103: 00000100:00100000:2.0:1789607332.356993:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149944832 00000100:00100000:2.0:1789607332.356997:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149944832 00000100:00100000:2.0:1789607332.357012:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789607332.357018:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+7:6464:x1876539149944320:12345-0@lo:104: 00010000:00010000:2.0:1789607332.357027:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357087:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607332.357093:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+7:6464:x1876539149944320:12345-0@lo:104: Request processed in 75us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.357098:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789607332.357111:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607332.357117:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+6:6464:x1876539149944448:12345-0@lo:104: 00010000:00010000:2.0:1789607332.357124:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357167:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607332.357172:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+6:6464:x1876539149944448:12345-0@lo:104: Request processed in 55us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.357177:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607332.357191:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607332.357197:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:6464:x1876539149944576:12345-0@lo:104: 00010000:00010000:2.0:1789607332.357204:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357230:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789607332.357235:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:6464:x1876539149944576:12345-0@lo:104: Request processed in 39us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.357240:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607332.357252:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607332.357258:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6464:x1876539149944832:12345-0@lo:104: 00010000:00010000:2.0:1789607332.357265:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357289:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789607332.357294:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6464:x1876539149944832:12345-0@lo:104: Request processed in 37us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.357299:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789607332.357315:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789607332.357320:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357326:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030c00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607332.357336:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357343:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607332.357350:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607332.357356:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789607332.357442:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944320:0@lo:104: 00000100:00100000:0.0:1789607332.357450:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944448:0@lo:104: 00000100:00100000:0.0:1789607332.357457:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944576:0@lo:104: 00000100:00100000:0.0:1789607332.357463:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7573800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944832:0@lo:104: 00010000:00010000:2.0:1789607332.357571:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357578:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789607332.357608:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149945216:0@lo:103: 00000100:00100000:0.0:1789607332.357632:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607332.357675:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357683:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c0030c00/0xa26202d240fbd42e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd435 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357693:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607332.357697:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357702:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607332.357705:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357711:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607332.357726:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607332.357730:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789607332.357756:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945216 00000100:00100000:1.0:1789607332.357761:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945216 00010000:00010000:1.0:1789607332.357776:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd42e expref: 20 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.357794:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607332.357799:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+20:3471:x1876539149945216:12345-0@lo:103: 00010000:00010000:1.0:1789607332.357817:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.357823:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd42e expref: 20 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.357832:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd42e expref: 20 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.357841:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184600/0xa26202d240fbd435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd42e expref: 20 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.357852:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607332.357966:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357973:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607332.357983:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357989:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd40b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.357998:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607332.358001:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358006:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607332.358009:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358015:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607332.358020:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607332.358024:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607332.358051:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358057:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607332.358063:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358069:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052200/0xa26202d240fbd3e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3ef expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358077:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607332.358089:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358094:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607332.358096:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358103:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607332.358107:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607332.358112:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607332.358124:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358129:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607332.358133:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358147:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd37f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd386 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.358156:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607332.358158:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607332.358159:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607332.358258:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+19:3471:x1876539149945216:12345-0@lo:103: Request processed in 457us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.358265:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607332.358285:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149945344:0@lo:103: 00000100:00100000:1.0:1789607332.358312:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.358334:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607332.358340:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149945472:0@lo:103: 00000100:00100000:1.0:1789607332.358370:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.358394:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945344 00000100:00100000:1.0:1789607332.358398:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945344 00010000:00010000:1.0:1789607332.358428:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd404 expref: 19 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.358446:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945472 00000100:00100000:1.0:1789607332.358450:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945472 00010000:00010000:1.0:1789607332.358461:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 20 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607332.358478:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607332.358479:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607332.358488:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f06ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+20:3468:x1876539149945344:12345-0@lo:103: 00000100:00100000:3.0:1789607332.358495:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c404f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:6464:x1876539149944704:12345-0@lo:104: 00010000:00010000:1.0:1789607332.358497:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.358504:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd404 expref: 20 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.358507:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.358516:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd404 expref: 20 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.358530:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9185000/0xa26202d240fbd40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd404 expref: 20 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.358540:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607332.358612:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607332.358621:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149945600:0@lo:103: 00000100:00100000:0.0:1789607332.360425:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149945216:0@lo:103: 00000100:00100000:1.0:1789607332.360558:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f06ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+19:3468:x1876539149945344:12345-0@lo:103: Request processed in 2070us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.360568:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607332.360621:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607332.360629:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+18:3468:x1876539149945472:12345-0@lo:103: 00010000:00010000:1.0:1789607332.360642:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.360662:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 18 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.360675:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 18 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.360690:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052800/0xa26202d240fbd3ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd3e8 expref: 18 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.360705:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607332.360733:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+17:3468:x1876539149945472:12345-0@lo:103: Request processed in 106us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.360738:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607332.360829:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149945472:0@lo:103: 00000100:00100000:0.0:1789607332.360837:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149945344:0@lo:103: 00010000:00010000:0.0:1789607332.360917:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607332.363034:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607332.363074:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607332.363094:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c404f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:6464:x1876539149944704:12345-0@lo:104: Request processed in 4603us (7472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.363106:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607332.363123:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945600 00000100:00100000:1.0:1789607332.363132:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945600 00010000:00010000:2.0:1789607332.363148:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607332.363156:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363162:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd37f expref: 17 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.363166:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607332.363171:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.363179:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607332.363187:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.363187:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 10000000:01000000:2.0:1789607332.363193:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789607332.363195:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+17:3470:x1876539149945600:12345-0@lo:103: 00010000:00010000:2.0:1789607332.363227:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.363233:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607332.363262:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.363269:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd3a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3b0 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.363284:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607332.363286:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607332.363287:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607332.363300:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149945728:0@lo:103: 00000100:00100000:0.0:1789607332.363375:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6464:1876539149944704:0@lo:104: 00000100:00100000:2.0:1789607332.363403:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607332.363423:0:6464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363488:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.363494:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd37f expref: 17 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363502:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd37f expref: 17 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363511:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd37f expref: 17 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363520:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607332.363555:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+16:3470:x1876539149945600:12345-0@lo:103: Request processed in 361us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.363561:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607332.363575:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945728 00000100:00100000:2.0:1789607332.363576:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149945600:0@lo:103: 00000100:00100000:1.0:1789607332.363681:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945728 00010000:00010000:1.0:1789607332.363693:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 16 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.363713:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607332.363719:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+16:3471:x1876539149945728:12345-0@lo:103: 00010000:00010000:1.0:1789607332.363727:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.363731:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 16 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363740:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 16 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363750:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9185400/0xa26202d240fbd3b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd3a9 expref: 16 pid: 6464 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363762:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363770:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363784:0:6454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363790:0:6454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363807:0:6454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363813:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363818:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607332.363822:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363828:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363848:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.363857:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607332.363908:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+15:3471:x1876539149945728:12345-0@lo:103: Request processed in 189us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.363914:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789607332.363970:0:6464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.363978:0:6464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.363984:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902053000/0xa26202d240fbd490 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607332.363996:0:6464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789607332.364356:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149945728:0@lo:103: 00000100:00100000:1.0:1789607332.411912:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+14:9058:x1876539149943936:12345-0@lo:253: Request processed in 67840us (68145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.411924:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789607332.412011:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149943936:0@lo:253: 10000000:01000000:0.0:1789607332.412026:0:9058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789607332.412029:0:9058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607332.412030:0:9058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607332.412032:0:9058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607332.412033:0:9058:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789607332.412035:0:9058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607332.412036:0:9058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607332.412037:0:9058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607332.412039:0:9058:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789607332.412040:0:9058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607332.412042:0:9058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607332.412126:0:9058:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d78f77e7800 from lustre-OST0001 10000000:01000000:0.0:1789607332.412149:0:9058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789607332.412152:0:9058:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789607332.412159:0:9058:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78e9ee99c0 local copy 10000000:01000000:0.0:1789607332.412163:0:9058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789607332.412245:0:9058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.412256:0:9058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.412284:0:9058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607332.412301:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149945856:0@lo:101: 00000100:00100000:0.0:1789607332.412336:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.412401:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607332.412435:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945856 00000100:00100000:1.0:1789607332.412441:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945856 00000100:00100000:1.0:1789607332.412499:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789607332.412507:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+14:9058:x1876539149945856:12345-0@lo:101: 00010000:00010000:1.0:1789607332.412518:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607332.412529:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902052800/0xa26202d240fbd49e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd497 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.412554:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902052800/0xa26202d240fbd49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd497 expref: 15 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.412564:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902052800/0xa26202d240fbd49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd497 expref: 15 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.412573:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902052800, rc 0) 00000100:00100000:1.0:1789607332.412611:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149945856:12345-0@lo:101: Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.412617:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789607332.412675:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149945856:0@lo:101: 00010000:00010000:2.0:1789607332.412686:0:9058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.412694:0:9058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607332.412778:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149945984:0@lo:501: 00000100:00100000:2.0:1789607332.412801:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607332.412902:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.413000:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149945984 00000100:00100000:0.0:1789607332.413004:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149945984 00000100:00100000:0.0:1789607332.413025:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607332.413031:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149945984:12345-0@lo:501: 00000100:00100000:0.0:1789607332.413292:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149945984:12345-0@lo:501: Request processed in 260us (489us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607332.413299:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789607332.413362:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149945984:0@lo:501: 10000000:01000000:2.0:1789607332.413374:0:9058:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789607332.413396:0:9058:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789607332.413401:0:9058:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.413418:0:9058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.413425:0:9058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.413443:0:9058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607332.413459:0:9058:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78f77e7800 10000000:01000000:2.0:1789607332.413462:0:9058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607332.413467:0:9058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789607332.413468:0:9058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607332.413472:0:9058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789607332.413474:0:9058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789607332.413487:0:9058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.413494:0:9058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.413501:0:9058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607332.413511:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946112:0@lo:101: 00000100:00100000:2.0:1789607332.413532:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607332.413542:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643ee40 going to sleep for 11 seconds 00010000:00010000:0.0:1789607332.413591:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607332.413596:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413603:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607332.413606:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413613:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607332.413618:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607332.413622:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789607332.413640:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413644:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607332.413664:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413669:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075d200/0xa26202d240fbd497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa26202d240fbd49e expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413677:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607332.413678:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607332.413679:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607332.413685:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607332.413692:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149946240:0@lo:103: 00000100:00100000:0.0:1789607332.413710:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.413729:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946240 00000100:00100000:0.0:1789607332.413731:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946240 00000100:00100000:0.0:1789607332.413751:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607332.413755:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+15:3469:x1876539149946240:12345-0@lo:103: 00010000:00010000:0.0:1789607332.413764:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607332.413775:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052800/0xa26202d240fbd49e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd497 expref: 15 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413787:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607332.413811:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+14:3469:x1876539149946240:12345-0@lo:103: Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.413818:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607332.413840:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149946240:0@lo:103: 00000100:00100000:0.0:1789607332.413853:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946112 00000100:00100000:0.0:1789607332.413882:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946112 00000100:00100000:0.0:1789607332.413897:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789607332.413902:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+14:9058:x1876539149946112:12345-0@lo:101: 00010000:00010000:0.0:1789607332.413908:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607332.413917:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd4a5 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413930:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413938:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 15 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.413944:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075cc00, rc 0) 00000100:00100000:0.0:1789607332.413972:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946112:12345-0@lo:101: Request processed in 69us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.413977:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789607332.414006:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946112:0@lo:101: 00010000:00010000:0.0:1789607332.414016:0:9058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.414023:0:9058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607332.414091:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946368:0@lo:501: 00000100:00100000:0.0:1789607332.414115:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.414127:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.414138:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946368 00000100:00100000:0.0:1789607332.414140:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946368 00000100:00100000:0.0:1789607332.414159:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789607332.414164:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946368:12345-0@lo:501: 00000100:00100000:0.0:1789607332.414377:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946368:12345-0@lo:501: Request processed in 212us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.414384:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789607332.414413:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946368:0@lo:501: 00000100:00100000:0.0:1789607332.414436:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946496:0@lo:503: 00000100:00100000:0.0:1789607332.414469:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.414480:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.414490:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946496 00000100:00100000:0.0:1789607332.414492:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946496 00000100:00100000:0.0:1789607332.414506:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789607332.414510:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946496:12345-0@lo:503: 00000100:00100000:0.0:1789607332.414621:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946496:12345-0@lo:503: Request processed in 109us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.414627:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789607332.414656:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946496:0@lo:503: 00000040:00080000:0.0:1789607332.414857:0:9058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607332.414918:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946624:0@lo:502: 00000100:00100000:0.0:1789607332.414946:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.414962:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.414975:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946624 00000100:00100000:0.0:1789607332.414978:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946624 00000100:00100000:0.0:1789607332.414994:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789607332.415006:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946624:12345-0@lo:502: 00000100:00100000:0.0:1789607332.415138:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946624:12345-0@lo:502: Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.415149:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789607332.415249:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946624:0@lo:502: 00000040:00080000:0.0:1789607332.415447:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789607332.415485:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789607332.415509:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789607332.415555:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789607332.415582:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789607332.415609:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789607332.415629:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946752:0@lo:502: 00000100:00100000:0.0:1789607332.415817:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607332.415878:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946752 00000100:00100000:2.0:1789607332.415882:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946752 00000100:00100000:2.0:1789607332.415908:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789607332.415917:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946752:12345-0@lo:502: 00000100:00100000:2.0:1789607332.416054:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946752:12345-0@lo:502: Request processed in 139us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.416060:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789607332.416250:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.416263:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946752:0@lo:502: 00000040:00080000:0.0:1789607332.416353:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789607332.416363:0:9058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1789607332.416917:0:9065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607332.416925:0:9065:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789607332.416931:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607332.416933:0:9065:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789607332.417093:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607332.417109:0:9065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d77c4550000) 00000020:00000080:2.0:1789607332.417132:0:9065:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789607332.417138:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607332.417196:0:9065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78f77e7800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789607332.417299:0:9065:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607332.417310:0:9065:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa26202d240fbd4ba 00010000:00010000:2.0:1789607332.420075:0:9065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789607332.420376:0:9065:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789607332.428399:0:9065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789607332.428690:0:9065:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789607332.437354:0:9065:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789607332.437907:0:9065:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789607332.442547:0:9065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789607332.442558:0:9065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607332.442564:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607332.442566:0:9065:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789607332.442568:0:9065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607332.442572:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607332.442573:0:9065:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607332.442575:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607332.442577:0:9065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789607332.442629:0:9065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607332.442632:0:9065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607332.442639:0:9065:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607332.442643:0:9065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789607332.442962:0:9058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789607332.442983:0:9058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789607332.443025:0:9058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.443035:0:9058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607332.443041:0:9058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f77e7800 from 1 10000000:01000000:1.0:1789607332.443043:0:9058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607332.443093:0:9058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.443346:0:9058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.443357:0:9058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.443383:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946880:0@lo:101: 00000100:00100000:1.0:1789607332.443434:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.443470:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607332.443473:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149946880 00000100:00100000:2.0:1789607332.443481:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149946880 00000100:00100000:2.0:1789607332.443519:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789607332.443529:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149946880:12345-0@lo:101: 00010000:00010000:2.0:1789607332.443541:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607332.443553:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd4c1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.443576:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 16 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.443584:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 16 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.443590:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021dbe00, rc 0) 00000100:00100000:2.0:1789607332.443628:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149946880:12345-0@lo:101: Request processed in 101us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.443635:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789607332.443654:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149946880:0@lo:101: 00010000:00010000:1.0:1789607332.443668:0:9058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.443677:0:9058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.443754:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947008:0@lo:501: 00000100:00100000:1.0:1789607332.443775:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.444399:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607332.444825:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947008 00000100:00100000:3.0:1789607332.444841:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947008 00000100:00100000:3.0:1789607332.444907:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789607332.444917:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947008:12345-0@lo:501: 00000100:00100000:3.0:1789607332.445845:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947008:12345-0@lo:501: Request processed in 927us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.445855:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789607332.446007:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947008:0@lo:501: 00000100:00100000:0.0:1789607332.446052:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947136:0@lo:503: 00000100:00100000:0.0:1789607332.446122:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.446160:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607332.446246:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947136 00000100:00100000:2.0:1789607332.446252:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947136 00000100:00100000:2.0:1789607332.446289:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789607332.446297:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947136:12345-0@lo:503: 00000100:00100000:2.0:1789607332.447062:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947136:12345-0@lo:503: Request processed in 763us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.447070:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789607332.447155:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947136:0@lo:503: 00000040:00080000:3.0:1789607332.447426:0:9058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607332.447492:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947264:0@lo:502: 00000100:00100000:3.0:1789607332.447534:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.447746:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607332.447800:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947264 00000100:00100000:2.0:1789607332.447806:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947264 00000100:00100000:2.0:1789607332.447854:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789607332.447883:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947264:12345-0@lo:502: 00000100:00100000:2.0:1789607332.448636:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947264:12345-0@lo:502: Request processed in 764us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.448645:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789607332.448760:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947264:0@lo:502: 00000040:00080000:1.0:1789607332.449525:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789607332.449585:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789607332.449613:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947392:0@lo:502: 00000100:00100000:1.0:1789607332.449653:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.449685:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.449691:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947392 00000100:00100000:0.0:1789607332.449697:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947392 00000100:00100000:0.0:1789607332.449731:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789607332.449739:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947392:12345-0@lo:502: 00000100:00100000:0.0:1789607332.450040:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947392:12345-0@lo:502: Request processed in 301us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607332.450048:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607332.450182:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947392:0@lo:502: 00000040:00080000:1.0:1789607332.450327:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789607332.450336:0:9058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789607332.450676:0:9069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607332.450685:0:9069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607332.450688:0:9069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789607332.450695:0:9069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78f77e7800 00000020:00000080:2.0:1789607332.450697:0:9069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607332.450716:0:9069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607332.450720:0:9069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607332.450722:0:9069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789607332.450725:0:9069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789607332.450948:0:9058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789607332.450978:0:9058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607332.450995:0:9058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.451018:0:9058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607332.451067:0:9058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789607332.451070:0:9058:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78f77e7800 10000000:01000000:1.0:1789607332.451073:0:9058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78f77e7800 10000000:01000000:1.0:1789607332.451077:0:9058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607332.451407:0:9058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78f77e7800 from 1 10000000:01000000:1.0:1789607332.451411:0:9058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607332.451437:0:9058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.451443:0:9058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.451450:0:9058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.451462:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947520:0@lo:101: 00000100:00100000:1.0:1789607332.451492:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.451521:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607332.451531:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947520 00000100:00100000:2.0:1789607332.451537:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947520 00000100:00100000:2.0:1789607332.451576:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789607332.451584:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:9058:x1876539149947520:12345-0@lo:101: 00010000:00010000:2.0:1789607332.451594:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607332.451606:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd4cf expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.451627:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.451637:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 17 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607332.451644:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021da600, rc 0) 00000100:00100000:2.0:1789607332.451688:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947520:12345-0@lo:101: Request processed in 105us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.451699:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789607332.451814:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947520:0@lo:101: 00010000:00010000:0.0:1789607332.451835:0:9058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.451841:0:9058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607332.451933:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947648:0@lo:501: 00000100:00100000:0.0:1789607332.451957:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.451980:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607332.451988:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947648 00000100:00100000:2.0:1789607332.452127:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947648 00000100:00100000:2.0:1789607332.452159:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789607332.452260:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947648:12345-0@lo:501: 00000100:00100000:2.0:1789607332.452473:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947648:12345-0@lo:501: Request processed in 307us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607332.452480:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789607332.452593:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947648:0@lo:501: 00000100:00100000:0.0:1789607332.452617:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947776:0@lo:503: 00000100:00100000:0.0:1789607332.452663:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.452686:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607332.452731:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947776 00000100:00100000:3.0:1789607332.452736:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947776 00000100:00100000:3.0:1789607332.452767:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789607332.452774:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947776:12345-0@lo:503: 00000100:00100000:3.0:1789607332.452937:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947776:12345-0@lo:503: Request processed in 163us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.452943:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789607332.454165:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947776:0@lo:503: 00000040:00080000:0.0:1789607332.454443:0:9058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607332.454514:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947904:0@lo:502: 00000100:00100000:0.0:1789607332.454552:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.454577:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607332.454691:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149947904 00000100:00100000:1.0:1789607332.454696:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149947904 00000100:00100000:1.0:1789607332.454726:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789607332.454734:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947904:12345-0@lo:502: 00000100:00100000:1.0:1789607332.454962:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149947904:12345-0@lo:502: Request processed in 228us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.454970:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789607332.455062:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149947904:0@lo:502: 00000040:00080000:0.0:1789607332.455381:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789607332.455414:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789607332.455430:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789607332.455454:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789607332.455472:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789607332.455495:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789607332.455512:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789607332.455528:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789607332.455564:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789607332.455583:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789607332.455599:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789607332.455638:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789607332.455672:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789607332.455711:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789607332.455758:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789607332.455792:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789607332.455830:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789607332.455995:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789607332.456036:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789607332.456069:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789607332.456127:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789607332.456162:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789607332.456195:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789607332.456242:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789607332.456277:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789607332.456309:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789607332.456370:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789607332.456416:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789607332.456447:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789607332.456491:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789607332.456524:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789607332.456553:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789607332.456582:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789607332.456626:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789607332.456663:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789607332.456709:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789607332.456744:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789607332.456764:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789607332.456789:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789607332.456806:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789607332.456821:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789607332.456849:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789607332.457077:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789607332.457128:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789607332.457163:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789607332.457212:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789607332.457253:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149948032:0@lo:502: 00000100:00100000:1.0:1789607332.457317:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.457399:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607332.457428:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948032 00000100:00100000:3.0:1789607332.457433:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948032 00000100:00100000:3.0:1789607332.457491:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789607332.457501:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149948032:12345-0@lo:502: 00000100:00100000:3.0:1789607332.457713:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149948032:12345-0@lo:502: Request processed in 213us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.457720:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789607332.457795:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149948032:0@lo:502: 00000040:00080000:0.0:1789607332.457886:0:9058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789607332.457895:0:9058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789607332.458492:0:9070:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789607332.458515:0:9070:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d77c4ce0000) 00000020:00000080:2.0:1789607332.458538:0:9070:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789607332.458610:0:9070:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78f77e7800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789607332.458614:0:9070:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78f77e7800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789607332.458617:0:9070:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78f77e7800 3 00010000:00080000:2.0:1789607332.458642:0:9070:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78f77e6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607332.460322:0:9070:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789607332.460551:0:9070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789607332.460589:0:9070:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607332.460601:0:9070:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa26202d240fbd4e4 00000100:00080000:0.0:1789607332.460611:0:9070:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607332.460620:0:9070:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78f77e6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607332.460653:0:9070:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cfc7f800 x1876539149948160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607332.460683:0:9070:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607332.460836:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149948672:0@lo:400: 00000100:00100000:3.0:1789607332.460913:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.460945:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149949184:0@lo:400: 00000100:00100000:3.0:1789607332.460973:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.460995:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607332.461001:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149948288:0@lo:400: 00000100:00100000:3.0:1789607332.461022:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.461037:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149948800:0@lo:400: 00000100:00100000:3.0:1789607332.461052:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.461074:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149948416:0@lo:400: 00000100:00100000:3.0:1789607332.461119:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.461136:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149948928:0@lo:400: 00000100:00100000:3.0:1789607332.461154:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.461170:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789607332.461176:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149948544:0@lo:400: 00000100:00100000:3.0:1789607332.461195:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.461209:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149949056:0@lo:400: 00000100:00100000:3.0:1789607332.461228:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.461253:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948672 00000100:00100000:3.0:1789607332.461259:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948672 00000100:00100000:3.0:1789607332.461293:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948416 00000100:00100000:3.0:1789607332.461296:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948416 00000100:00100000:3.0:1789607332.461312:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607332.461319:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149948672:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461370:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149948672:12345-0@lo:400: Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461386:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607332.461402:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607332.461408:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149948416:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461440:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149948416:12345-0@lo:400: Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461446:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607332.461462:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949184 00000100:00100000:3.0:1789607332.461466:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949184 00000100:00100000:3.0:1789607332.461494:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949056 00000100:00100000:3.0:1789607332.461497:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949056 00000100:00100000:3.0:1789607332.461510:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607332.461516:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149949184:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461545:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149949184:12345-0@lo:400: Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461550:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607332.461560:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607332.461566:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149949056:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461589:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149949056:12345-0@lo:400: Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461594:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607332.461608:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948288 00000100:00100000:3.0:1789607332.461611:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948288 00000100:00100000:3.0:1789607332.461626:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948800 00000100:00100000:3.0:1789607332.461628:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948800 00000100:00100000:3.0:1789607332.461637:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948928 00000100:00100000:3.0:1789607332.461640:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948928 00000100:00100000:3.0:1789607332.461650:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948544 00000100:00100000:3.0:1789607332.461652:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948544 00000100:00100000:3.0:1789607332.461671:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607332.461676:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149948288:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461702:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149948288:12345-0@lo:400: Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461708:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607332.461718:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607332.461723:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149948800:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461747:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149948800:12345-0@lo:400: Request processed in 24us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461752:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607332.461762:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607332.461768:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149948928:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461793:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149948928:12345-0@lo:400: Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461798:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607332.461808:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607332.461813:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149948544:12345-0@lo:400: 00000100:00100000:3.0:1789607332.461835:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149948544:12345-0@lo:400: Request processed in 23us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.461840:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789607332.461898:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607332.461903:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607332.461905:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607332.461941:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fc907100 x1876539149948544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.461953:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149948544:0@lo:400: 00010000:00080000:3.0:1789607332.461973:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fc904700 x1876539149949056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.461981:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149949056:0@lo:400: 00000100:00100000:3.0:1789607332.461990:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149948416:0@lo:400: 00010000:00080000:3.0:1789607332.461999:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fc906680 x1876539149948928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.462006:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149948928:0@lo:400: 00010000:00080000:3.0:1789607332.462037:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fc907b80 x1876539149948288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.462046:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149948288:0@lo:400: 00010000:00080000:3.0:1789607332.462055:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fc905880 x1876539149948800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.462063:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149948800:0@lo:400: 00000100:00100000:3.0:1789607332.462071:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149948672:0@lo:400: 00010000:00080000:3.0:1789607332.462112:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fc907480 x1876539149949184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.462121:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149949184:0@lo:400: 00000100:00100000:1.0:1789607332.462952:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539149948160:0@lo:38: 00000100:00100000:1.0:1789607332.463020:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.463321:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149948160 00000100:00100000:3.0:1789607332.463328:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149948160 00000100:00100000:3.0:1789607332.463357:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607332.463363:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539149948160:12345-0@lo:38: 00010000:00080000:3.0:1789607332.463388:0:6468:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1789607332.463428:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa26202d240fbd4eb 00000004:00100000:3.0:1789607332.463442:0:6468:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607332.463474:0:6468:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607332.463531:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3467:x1876539149948160:12345-0@lo:38: Request processed in 167us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.463537:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1789607332.463943:0:9070:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00080000:3.0:1789607332.463945:0:9071:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8d78fcd83480 x1876539149949312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.463953:0:9071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36240 going to sleep for 0 seconds 00000020:00000080:0.0:1789607332.463960:0:9070:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d78fd3f19c0) 00000020:00000080:0.0:1789607332.463980:0:9070:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789607332.464040:0:9070:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78f77e7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607332.464043:0:9070:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78f77e7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607332.464046:0:9070:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78f77e7800 3 00010000:00080000:0.0:1789607332.464070:0:9070:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7901fec800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00080000:2.0:1789607332.464417:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7f800 x1876539149948160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607332.464427:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607332.464434:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789607332.464442:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789607332.464446:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789607332.464449:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789607332.464454:0:3467:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000097e65d72): req@ffff8d78fcd83480 x1876539149949312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607332.464470:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539149948160:0@lo:38: 00000100:00100000:3.0:1789607332.464570:0:9071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.464600:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949312 00000100:00100000:3.0:1789607332.464604:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949312 00000100:00100000:3.0:1789607332.464677:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607332.464685:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9071:x1876539149949312:12345-0@lo:901: 00000100:00100000:3.0:1789607332.465199:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9071:x1876539149949312:12345-0@lo:901: Request processed in 515us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.465207:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789607332.465241:0:9071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fcd83480 x1876539149949312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789607348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607332.465251:0:9071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9071:1876539149949312:0@lo:901: 00010000:00010000:0.0:1789607332.465486:0:9070:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00080000:2.0:1789607332.465592:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1789607332.465636:0:9070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789607332.465662:0:9070:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607332.465669:0:9070:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa26202d240fbd4f9 00000100:00080000:0.0:1789607332.465674:0:9070:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607332.465681:0:9070:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d7901fec800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607332.465702:0:9070:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cfc7d180 x1876539149949440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607332.465758:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539149949440:0@lo:38: 00000100:00100000:2.0:1789607332.465796:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607332.465859:0:9070:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789607332.465891:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949440 00000100:00100000:3.0:1789607332.465897:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949440 00000100:00100000:3.0:1789607332.465933:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607332.465939:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539149949440:12345-0@lo:38: 00010000:00080000:3.0:1789607332.465958:0:6470:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1789607332.466047:0:6470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa26202d240fbd500 00000004:00100000:3.0:1789607332.466059:0:6470:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607332.466100:0:6470:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ba4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607332.466151:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3467:x1876539149949440:12345-0@lo:38: Request processed in 211us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.466158:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789607332.466366:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfc7d180 x1876539149949440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607332.466375:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607332.466380:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789607332.466387:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789607332.466392:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789607332.466394:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7901fec800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789607332.466400:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539149949440:0@lo:38: 00000040:00080000:2.0:1789607332.466672:0:9070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789607332.466952:0:9058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789607332.466983:0:9058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789607332.470143:0:9058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607332.470160:0:9058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789607332.470223:0:9058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789607332.470225:0:9058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607332.470227:0:9058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607332.470229:0:9058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607332.470230:0:9058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607332.470232:0:9058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607332.470234:0:9058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607332.470236:0:9058:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607332.470237:0:9058:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607332.470239:0:9058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607332.470241:0:9058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789607332.470245:0:9058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789607332.470248:0:9058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789607332.470250:0:9058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607332.470252:0:9058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607332.470253:0:9058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607332.470254:0:9058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607332.470255:0:9058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607332.470257:0:9058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607332.470258:0:9058:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607332.470260:0:9058:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607332.470261:0:9058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607332.470263:0:9058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789607332.470289:0:9058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789607332.470308:0:9058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149949568:0@lo:253: 00000100:00100000:0.0:1789607332.470384:0:9058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607332.470448:0:9058:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607332.470481:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949568 00000100:00100000:0.0:1789607332.470487:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949568 00000100:00100000:0.0:1789607332.470535:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789607332.470545:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9058:x1876539149949568:12345-0@lo:253: 20000000:01000000:0.0:1789607332.470572:0:6462:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789607332.470586:0:6462:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789607332.494367:0:6462:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789607332.494381:0:6462:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789607332.494453:0:6484:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789607332.494459:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789607332.494479:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494498:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494506:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd43c expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494513:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494548:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd43c expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494560:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd43c expref: 17 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607332.494573:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149949696:0@lo:104: 00000100:00100000:3.0:1789607332.494631:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607332.494676:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 17 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494684:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 17 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607332.494708:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149949824:0@lo:104: 00000100:00100000:3.0:1789607332.494731:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.494748:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0075a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607332.494767:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949696 00000100:00100000:3.0:1789607332.494773:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949696 00000100:00100000:3.0:1789607332.494811:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949824 00000100:00100000:3.0:1789607332.494814:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949824 00000100:00100000:3.0:1789607332.494829:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789607332.494836:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6484:x1876539149949696:12345-0@lo:104: 00010000:00010000:3.0:1789607332.494849:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.494926:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607332.494933:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+4:6484:x1876539149949696:12345-0@lo:104: Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.494939:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789607332.494956:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607332.494962:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149949824:12345-0@lo:104: 00010000:00010000:3.0:1789607332.494970:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495009:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607332.495014:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+3:6484:x1876539149949824:12345-0@lo:104: Request processed in 53us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.495020:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789607332.495044:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607332.495051:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495064:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607332.495068:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495076:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607332.495094:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607332.495100:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607332.495139:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495146:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607332.495164:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495171:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbd43c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd443 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495183:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607332.495186:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495191:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607332.495194:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495211:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607332.495218:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607332.495223:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607332.495550:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495558:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789607332.495597:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149950080:0@lo:103: 00000100:00100000:0.0:1789607332.495630:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607332.495696:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950080 00000100:00100000:1.0:1789607332.495702:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950080 00010000:00010000:1.0:1789607332.495723:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 18 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.495760:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607332.495767:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+18:3470:x1876539149950080:12345-0@lo:103: 00010000:00010000:1.0:1789607332.495777:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607332.495783:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 18 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.495791:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 18 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607332.495805:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607332.495899:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495906:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd3f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3fd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.495920:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607332.495921:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607332.495923:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607332.495928:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607332.495937:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149949952:0@lo:103: 00000100:00100000:3.0:1789607332.495961:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607332.495994:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149949952 00000100:00100000:3.0:1789607332.495998:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149949952 00010000:00010000:3.0:1789607332.496010:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd43c expref: 19 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607332.496029:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607332.496042:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3469:x1876539149949952:12345-0@lo:103: 00010000:00010000:3.0:1789607332.496049:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607332.496053:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd43c expref: 19 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496073:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd43c expref: 19 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496093:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496100:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607332.496111:0:6456:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003448739s 00010000:00010000:3.0:1789607332.496116:0:6456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496123:0:6456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496129:0:6456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496136:0:6456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496142:0:6456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607332.496146:0:6456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496153:0:6456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496173:0:6456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496183:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607332.496212:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3469:x1876539149949952:12345-0@lo:103: Request processed in 170us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.496218:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607332.496263:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149949952:0@lo:103: 00010000:00010000:3.0:1789607332.496292:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184800/0xa26202d240fbd443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd43c expref: 18 pid: 6462 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607332.496596:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149949696:0@lo:104: 00010000:00010000:3.0:1789607332.496611:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd3fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd3f6 expref: 17 pid: 6463 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607332.496620:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6484:1876539149949824:0@lo:104: 00010000:00010000:3.0:1789607332.496633:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496641:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496647:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607332.496652:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0031800/0xa26202d240fbd507 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607332.497448:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+16:3470:x1876539149950080:12345-0@lo:103: Request processed in 1678us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607332.497458:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789607332.497571:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149950080:0@lo:103: 00000100:00100000:3.0:1789607332.512136:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:9058:x1876539149949568:12345-0@lo:253: Request processed in 41585us (41747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607332.512151:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789607332.512253:0:9058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c0415db0-4674-4bfe-9696-a490439e72d4:9058:1876539149949568:0@lo:253: 10000000:01000000:0.0:1789607332.512268:0:9058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789607332.512271:0:9058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607332.512273:0:9058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607332.512274:0:9058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607332.512275:0:9058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607332.512277:0:9058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607332.512278:0:9058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607332.512280:0:9058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607332.512282:0:9058:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607332.512283:0:9058:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607332.512285:0:9058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607332.512286:0:9058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789607332.512299:0:9058:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789607332.517194:0:9058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607332.517386:0:9058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607332.517823:0:9058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607332.518013:0:9058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607332.518304:0:9058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607332.518622:0:9058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789607332.519887:0:9058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789607332.888794:0:9058:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789607332.888820:0:9058:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789607332.888896:0:9058:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789607332.889202:0:9058:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789607332.889223:0:9058:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789607332.889259:0:9058:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789607333.029443:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607333.602389:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607333.602412:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149950208:0@lo:13: 00000100:00100000:3.0:1789607333.602476:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607333.602535:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950208 00000100:00100000:3.0:1789607333.602543:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950208 00000100:00100000:3.0:1789607333.602586:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607333.602595:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149950208:12345-0@lo:13: 00002000:00000024:3.0:1789607333.602625:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607333.602667:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149950208:12345-0@lo:13: Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607333.602673:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789607333.602710:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc904e00 x1876539149950208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607333.602728:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149950208:0@lo:13: 00000100:00100000:0.0:1789607333.606595:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607333.606635:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149950336:0@lo:13: 00000100:00100000:0.0:1789607333.606699:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607333.606753:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950336 00000100:00100000:0.0:1789607333.606761:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950336 00000100:00100000:0.0:1789607333.606953:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607333.606964:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149950336:12345-0@lo:13: 00002000:00000024:0.0:1789607333.606994:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607333.607037:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149950336:12345-0@lo:13: Request processed in 75us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607333.607043:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789607333.607308:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7ea00 x1876539149950336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607333.607328:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149950336:0@lo:13: 00010000:00010000:3.0:1789607334.051082:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607334.114702:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607334.114726:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149950464:0@lo:41: 00000100:00100000:1.0:1789607334.114804:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607334.114890:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950464 00000100:00100000:1.0:1789607334.114898:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950464 00000100:00100000:1.0:1789607334.115472:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789607334.115483:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149950464:12345-0@lo:41: 00000004:00000024:1.0:1789607334.115519:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607334.115578:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149950464:12345-0@lo:41: Request processed in 98us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607334.115585:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789607334.115819:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149950464:0@lo:41: 00000100:00100000:2.0:1789607334.627217:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607334.627244:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149950592:0@lo:41: 00000100:00100000:2.0:1789607334.627309:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607334.627564:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950592 00000100:00100000:1.0:1789607334.627573:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950592 00000100:00100000:1.0:1789607334.627626:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607334.627636:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149950592:12345-0@lo:41: 00000004:00000024:1.0:1789607334.627674:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607334.627728:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149950592:12345-0@lo:41: Request processed in 94us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607334.627735:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607334.627836:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149950592:0@lo:41: 00010000:00010000:0.0:1789607335.075269:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607336.098043:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607337.129293:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607337.698221:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149950976:0@lo:400: 00000100:00100000:3.0:1789607337.698332:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607337.698406:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149951488:0@lo:400: 00000100:00100000:3.0:1789607337.698435:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607337.698453:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149952000:0@lo:400: 00000100:00100000:3.0:1789607337.698494:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607337.698524:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789607337.698530:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149950848:0@lo:400: 00000100:00100000:3.0:1789607337.698554:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607337.698575:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149951360:0@lo:400: 00000100:00100000:3.0:1789607337.698724:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607337.698746:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149951872:0@lo:400: 00000100:00100000:3.0:1789607337.698768:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607337.698802:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950976 00000100:00100000:3.0:1789607337.698811:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950976 00000100:00100000:3.0:1789607337.698895:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607337.698906:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149950976:12345-0@lo:400: 00000100:00100000:3.0:1789607337.698962:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149950976:12345-0@lo:400: Request processed in 59us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.698968:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607337.698990:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951488 00000100:00100000:3.0:1789607337.698994:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951488 00000100:00100000:3.0:1789607337.699029:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952000 00000100:00100000:3.0:1789607337.699032:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952000 00000100:00100000:3.0:1789607337.699057:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950848 00000100:00100000:3.0:1789607337.699060:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950848 00000100:00100000:3.0:1789607337.699076:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951360 00000100:00100000:3.0:1789607337.699078:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951360 00000100:00100000:3.0:1789607337.699088:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951872 00000100:00100000:3.0:1789607337.699090:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951872 00000100:00100000:3.0:1789607337.699103:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607337.699109:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149951488:12345-0@lo:400: 00000100:00100000:3.0:1789607337.699143:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149951488:12345-0@lo:400: Request processed in 34us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.699157:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607337.699171:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607337.699177:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149952000:12345-0@lo:400: 00000100:00100000:3.0:1789607337.699206:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149952000:12345-0@lo:400: Request processed in 30us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.699212:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607337.699224:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607337.699230:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149950848:12345-0@lo:400: 00000100:00100000:3.0:1789607337.699256:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149950848:12345-0@lo:400: Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.699261:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607337.699278:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607337.699284:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149951360:12345-0@lo:400: 00000100:00100000:2.0:1789607337.699505:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149950720:0@lo:400: 00000100:00100000:2.0:1789607337.699553:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607337.699677:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149951232:0@lo:400: 00000100:00100000:2.0:1789607337.699707:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607337.699729:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149951744:0@lo:400: 00000100:00100000:2.0:1789607337.699753:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607337.699777:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789607337.699796:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149951104:0@lo:400: 00000100:00100000:2.0:1789607337.699822:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607337.699835:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149951616:0@lo:400: 00000100:00100000:2.0:1789607337.699892:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607337.699931:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951104 00000100:00100000:2.0:1789607337.699937:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951104 00000100:00100000:2.0:1789607337.699964:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607337.699971:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149951872:12345-0@lo:400: 00000100:00100000:2.0:1789607337.700010:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149951872:12345-0@lo:400: Request processed in 40us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607337.700016:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607337.700030:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789607337.700034:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149951104:12345-0@lo:400: 00000100:00100000:2.0:1789607337.700084:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149951104:12345-0@lo:400: Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607337.700089:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789607337.700107:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607337.700112:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607337.700124:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149950720 00000100:00100000:2.0:1789607337.700128:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149950720 00000100:00100000:1.0:1789607337.700159:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951232 00000100:00100000:1.0:1789607337.700164:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951232 00000100:00100000:1.0:1789607337.700196:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789607337.700204:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149951232:12345-0@lo:400: 00000100:00100000:3.0:1789607337.700253:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149951360:12345-0@lo:400: Request processed in 967us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607337.700255:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149951232:12345-0@lo:400: Request processed in 53us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.700260:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607337.700268:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789607337.700396:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc907b80 x1876539149950848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.700413:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149950848:0@lo:400: 00010000:00080000:3.0:1789607337.700432:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc907100 x1876539149951360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.700439:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149951360:0@lo:400: 00010000:00080000:3.0:1789607337.700449:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0d880 x1876539149951872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.700468:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149951872:0@lo:400: 00000100:00100000:3.0:1789607337.700482:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149950976:0@lo:400: 00010000:00080000:3.0:1789607337.700493:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539149951488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.700501:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149951488:0@lo:400: 00010000:00080000:3.0:1789607337.700511:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0f800 x1876539149952000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.700517:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149952000:0@lo:400: 00000100:00100000:3.0:1789607337.700667:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951744 00000100:00100000:3.0:1789607337.700672:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951744 00000100:00100000:3.0:1789607337.700711:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149951616 00000100:00100000:3.0:1789607337.700714:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149951616 00000100:00100000:3.0:1789607337.700731:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607337.700738:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149951744:12345-0@lo:400: 00000100:00100000:3.0:1789607337.700782:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149951744:12345-0@lo:400: Request processed in 44us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.700789:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607337.700804:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607337.700811:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149951616:12345-0@lo:400: 00000100:00100000:3.0:1789607337.700839:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149951616:12345-0@lo:400: Request processed in 29us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607337.700846:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607337.700948:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789607337.700960:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:3471:x1876539149950720:12345-0@lo:400: 00000100:00100000:2.0:1789607337.701002:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:3471:x1876539149950720:12345-0@lo:400: Request processed in 46us (1448us total) trans 0 rc 0/0 00010000:00080000:3.0:1789607337.701064:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc904a80 x1876539149951104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.701091:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149951104:0@lo:400: 00010000:00080000:3.0:1789607337.701105:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83480 x1876539149951616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.701112:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149951616:0@lo:400: 00000100:00100000:3.0:1789607337.701121:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149950720:0@lo:400: 00000100:00100000:3.0:1789607337.701133:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149951232:0@lo:400: 00010000:00080000:3.0:1789607337.701142:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0ce00 x1876539149951744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607337.701149:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149951744:0@lo:400: 00000100:00080000:3.0:1789607337.701194:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607337.701304:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:0.0:1789607338.149392:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607338.722510:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149952128:0@lo:13: 00000100:00100000:1.0:1789607338.722621:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607338.722725:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952128 00000100:00100000:1.0:1789607338.722735:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952128 00000100:00100000:1.0:1789607338.722805:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607338.722815:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149952128:12345-0@lo:13: 00002000:00000024:1.0:1789607338.722876:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607338.722925:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149952128:12345-0@lo:13: Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607338.722932:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789607338.723000:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f7570e00 x1876539149952128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607338.723020:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149952128:0@lo:13: 00000100:00100000:1.0:1789607338.726468:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149952256:0@lo:13: 00000100:00100000:1.0:1789607338.726558:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607338.726640:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952256 00000100:00100000:1.0:1789607338.726649:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952256 00000100:00100000:1.0:1789607338.726699:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607338.726709:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149952256:12345-0@lo:13: 00002000:00000024:1.0:1789607338.726737:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607338.726796:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149952256:12345-0@lo:13: Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607338.726803:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789607338.726851:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f7570e00 x1876539149952256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607338.726915:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149952256:0@lo:13: 00010000:00010000:0.0:1789607339.171568:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607339.234137:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607339.234162:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149952384:0@lo:41: 00000100:00100000:0.0:1789607339.234230:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607339.234461:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952384 00000100:00100000:2.0:1789607339.234470:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952384 00000100:00100000:2.0:1789607339.234533:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789607339.234542:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149952384:12345-0@lo:41: 00000004:00000024:2.0:1789607339.234582:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607339.234792:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149952384:12345-0@lo:41: Request processed in 251us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607339.234800:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607339.235095:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149952384:0@lo:41: 00000100:00100000:2.0:1789607339.746835:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607339.746881:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149952512:0@lo:41: 00000100:00100000:2.0:1789607339.746972:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607339.747048:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952512 00000100:00100000:2.0:1789607339.747055:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952512 00000100:00100000:2.0:1789607339.747099:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607339.747107:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149952512:12345-0@lo:41: 00000004:00000024:2.0:1789607339.747661:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607339.747730:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149952512:12345-0@lo:41: Request processed in 623us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607339.747737:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607339.749164:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149952512:0@lo:41: 00010000:00010000:0.0:1789607340.205692:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607341.243605:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607341.287008:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789607341.287024:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7901022000 from 39 10000000:01000000:1.0:1789607341.287030:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607341.287077:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607341.287089:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607341.287101:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607341.287123:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149952640:0@lo:101: 00000100:00100000:1.0:1789607341.287201:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607341.287258:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.287517:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952640 00000100:00100000:2.0:1789607341.287525:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952640 00000100:00100000:2.0:1789607341.287575:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789607341.287584:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149952640:12345-0@lo:101: 00010000:00010000:2.0:1789607341.287598:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607341.287609:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd50e expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.287632:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd50e expref: 16 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.287642:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd50e expref: 16 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.287663:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021db000, rc 0) 00000100:00100000:2.0:1789607341.287712:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149952640:12345-0@lo:101: Request processed in 129us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.287719:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789607341.289308:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149952640:0@lo:101: 00010000:00010000:1.0:1789607341.289334:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607341.289346:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607341.289412:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149952768:0@lo:501: 00000100:00100000:1.0:1789607341.289456:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607341.289498:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.289556:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952768 00000100:00100000:2.0:1789607341.289562:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952768 00000100:00100000:2.0:1789607341.289607:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789607341.289616:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149952768:12345-0@lo:501: 00000100:00100000:2.0:1789607341.290257:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149952768:12345-0@lo:501: Request processed in 640us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.290266:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789607341.290314:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149952768:0@lo:501: 00000100:00100000:2.0:1789607341.290348:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149952896:0@lo:503: 00000100:00100000:2.0:1789607341.290391:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.290408:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.290421:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149952896 00000100:00100000:2.0:1789607341.290425:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149952896 00000100:00100000:2.0:1789607341.290444:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789607341.290450:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149952896:12345-0@lo:503: 00000100:00100000:2.0:1789607341.290744:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149952896:12345-0@lo:503: Request processed in 292us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.290751:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789607341.290787:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149952896:0@lo:503: 00000100:00100000:0.0:1789607341.321677:0:9382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9382:1876539149953024:0@lo:502: 00000100:00100000:0.0:1789607341.321764:0:9382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.321838:0:9382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78faa28600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607341.321977:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953024 00000100:00100000:1.0:1789607341.321998:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953024 00000100:00100000:1.0:1789607341.322053:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789607341.322062:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:9382:x1876539149953024:12345-0@lo:502: 00000100:00100000:2.0:1789607341.335151:0:9382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9382:1876539149953024:0@lo:502: 00000100:00100000:2.0:1789607341.335258:0:9382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9382:1876539149953152:0@lo:502: 00000100:00100000:2.0:1789607341.335320:0:9382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.335361:0:9382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.337973:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953152 00000100:00100000:0.0:1789607341.337988:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953152 00000100:00100000:0.0:1789607341.338043:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789607341.338054:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9382:x1876539149953152:12345-0@lo:502: 00000100:00100000:0.0:1789607341.338356:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9382:x1876539149953152:12345-0@lo:502: Request processed in 303us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.338363:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789607341.338972:0:9382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9382:1876539149953152:0@lo:502: 00000040:00080000:2.0:1789607341.339012:0:9382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789607341.339536:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789607341.339563:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789607341.339574:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.339586:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607341.339597:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789607341.339599:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789607341.339602:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607341.339644:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.339652:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.339663:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607341.339683:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953280:0@lo:101: 00000100:00100000:0.0:1789607341.339728:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.339777:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78faa28540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.340488:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953280 00000100:00100000:2.0:1789607341.340497:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953280 00000100:00100000:2.0:1789607341.340539:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789607341.340549:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149953280:12345-0@lo:101: 00010000:00010000:2.0:1789607341.340561:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607341.340576:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd51c expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.340601:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd51c expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.340620:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd51c expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.340630:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021dba00, rc 0) 00000100:00100000:2.0:1789607341.340679:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149953280:12345-0@lo:101: Request processed in 132us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.340686:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789607341.340726:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953280:0@lo:101: 00010000:00010000:2.0:1789607341.340739:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.340759:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607341.341306:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953408:0@lo:501: 00000100:00100000:2.0:1789607341.341342:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.341361:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.341375:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953408 00000100:00100000:2.0:1789607341.343434:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953408 00000100:00100000:2.0:1789607341.343501:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789607341.343510:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149953408:12345-0@lo:501: 00000100:00100000:2.0:1789607341.344431:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149953408:12345-0@lo:501: Request processed in 919us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.344441:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789607341.344501:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953408:0@lo:501: 00000100:00100000:2.0:1789607341.344547:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953536:0@lo:503: 00000100:00100000:2.0:1789607341.344592:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.344618:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.344632:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953536 00000100:00100000:2.0:1789607341.344637:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953536 00000100:00100000:2.0:1789607341.344659:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789607341.344666:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149953536:12345-0@lo:503: 00000100:00100000:2.0:1789607341.353828:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149953536:12345-0@lo:503: Request processed in 9152us (9225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.353843:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607341.354292:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd592d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953536:0@lo:503: 00000100:00100000:1.0:1789607341.357145:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9382:x1876539149953024:12345-0@lo:502: Request processed in 35077us (35373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607341.357159:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789607341.357526:0:9385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9385:1876539149953664:0@lo:502: 00000100:00100000:0.0:1789607341.357592:0:9385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.357638:0:9385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78faa28600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.359307:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953664 00000100:00100000:2.0:1789607341.359324:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953664 00000100:00100000:2.0:1789607341.359388:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789607341.359398:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9385:x1876539149953664:12345-0@lo:502: 00000100:00100000:2.0:1789607341.360238:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9385:x1876539149953664:12345-0@lo:502: Request processed in 839us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.360247:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789607341.361907:0:9385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9385:1876539149953664:0@lo:502: 00000020:01000000:1.0:1789607341.361954:0:9385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607341.361963:0:9385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607341.361965:0:9385:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607341.361970:0:9385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607341.361972:0:9385:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789607341.362023:0:9385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9385:1876539149953792:0@lo:502: 00000100:00100000:1.0:1789607341.362081:0:9385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607341.362123:0:9385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.362295:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953792 00000100:00100000:3.0:1789607341.362303:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953792 00000100:00100000:3.0:1789607341.362349:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789607341.362357:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9385:x1876539149953792:12345-0@lo:502: 00000100:00100000:3.0:1789607341.362581:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:9385:x1876539149953792:12345-0@lo:502: Request processed in 224us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.362588:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789607341.363233:0:9385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9385:1876539149953792:0@lo:502: 00000020:01000000:2.0:1789607341.363263:0:9385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607341.363269:0:9385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607341.363271:0:9385:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607341.363275:0:9385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789607341.369722:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789607341.369755:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789607341.369767:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.369780:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607341.369802:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789607341.369804:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78f05a9800 from 39 10000000:01000000:3.0:1789607341.369807:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607341.369845:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.369855:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.369890:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.369915:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953920:0@lo:101: 00000100:00100000:3.0:1789607341.369981:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.370041:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.370650:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149953920 00000100:00100000:2.0:1789607341.370659:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149953920 00000100:00100000:2.0:1789607341.370709:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789607341.370719:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149953920:12345-0@lo:101: 00010000:00010000:2.0:1789607341.370732:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607341.370745:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd52a expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.370768:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd52a expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.370779:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd52a expref: 18 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.370787:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79021da400, rc 0) 00000100:00100000:2.0:1789607341.370851:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149953920:12345-0@lo:101: Request processed in 134us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.370858:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789607341.370939:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149953920:0@lo:101: 00010000:00010000:2.0:1789607341.370962:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.370972:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607341.371032:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954048:0@lo:501: 00000100:00100000:2.0:1789607341.371060:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.371082:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.371095:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954048 00000100:00100000:2.0:1789607341.371098:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954048 00000100:00100000:2.0:1789607341.371118:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789607341.371124:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149954048:12345-0@lo:501: 00000100:00100000:2.0:1789607341.372258:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149954048:12345-0@lo:501: Request processed in 1130us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.372268:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789607341.374649:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd592a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954048:0@lo:501: 00000100:00100000:0.0:1789607341.374710:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954176:0@lo:503: 00000100:00100000:0.0:1789607341.374776:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.374818:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78faa286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.375472:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954176 00000100:00100000:2.0:1789607341.375480:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954176 00000100:00100000:2.0:1789607341.375524:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789607341.375532:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149954176:12345-0@lo:503: 00000100:00100000:2.0:1789607341.375720:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149954176:12345-0@lo:503: Request processed in 187us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.375727:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789607341.375772:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954176:0@lo:503: 00000100:00100000:2.0:1789607341.376569:0:9387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9387:1876539149954304:0@lo:502: 00000100:00100000:2.0:1789607341.376629:0:9387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.376663:0:9387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.376739:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954304 00000100:00100000:0.0:1789607341.376744:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954304 00000100:00100000:0.0:1789607341.376770:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789607341.376778:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:9387:x1876539149954304:12345-0@lo:502: 00000100:00100000:0.0:1789607341.377038:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:9387:x1876539149954304:12345-0@lo:502: Request processed in 260us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.377045:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789607341.377085:0:9387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9387:1876539149954304:0@lo:502: 00000100:00100000:3.0:1789607341.377134:0:9387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9387:1876539149954432:0@lo:502: 00000100:00100000:3.0:1789607341.377168:0:9387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.377194:0:9387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.377339:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954432 00000100:00100000:0.0:1789607341.377344:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954432 00000100:00100000:0.0:1789607341.377378:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789607341.377385:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:9387:x1876539149954432:12345-0@lo:502: 00000100:00100000:0.0:1789607341.390520:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:9387:x1876539149954432:12345-0@lo:502: Request processed in 13118us (13333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.390536:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789607341.395050:0:9387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9387:1876539149954432:0@lo:502: 00000040:00080000:3.0:1789607341.395099:0:9387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789607341.395933:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789607341.395967:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607341.395980:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607341.395992:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607341.398200:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789607341.398208:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78f05a9800 from 6 10000000:01000000:0.0:1789607341.398214:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789607341.398264:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.398290:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.398304:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607341.398328:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954560:0@lo:101: 00000100:00100000:0.0:1789607341.398410:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.398456:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78faa28900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.399106:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954560 00000100:00100000:3.0:1789607341.399115:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954560 00000100:00100000:3.0:1789607341.399159:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607341.399168:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149954560:12345-0@lo:101: 00010000:00010000:3.0:1789607341.399182:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607341.399202:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd53f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd538 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.399226:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd538 expref: 19 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.399237:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd538 expref: 19 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.399245:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031000, rc 0) 00000100:00100000:3.0:1789607341.399293:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149954560:12345-0@lo:101: Request processed in 126us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.399300:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607341.399345:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954560:0@lo:101: 00010000:00010000:3.0:1789607341.399359:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.407837:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.407967:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954688:0@lo:256: 00000100:00100000:3.0:1789607341.408055:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.408095:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.408952:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954688 00000100:00100000:0.0:1789607341.408964:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954688 00000100:00100000:0.0:1789607341.409033:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789607341.409043:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149954688:12345-0@lo:256: 20000000:01000000:0.0:1789607341.409064:0:6464:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789607341.409084:0:6464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789607341.409087:0:6464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789607341.409188:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149954688:12345-0@lo:256: Request processed in 146us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.409195:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789607341.413758:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954688:0@lo:256: 10000000:01000000:3.0:1789607341.413826:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607341.413836:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.413846:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607341.413887:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789607341.413889:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789607341.413892:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789607341.413930:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.413937:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.413946:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.413964:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954816:0@lo:101: 00000100:00100000:3.0:1789607341.414040:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.414072:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.414468:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954816 00000100:00100000:0.0:1789607341.414476:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954816 00000100:00100000:0.0:1789607341.414530:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789607341.414539:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149954816:12345-0@lo:101: 00010000:00010000:0.0:1789607341.414552:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607341.414564:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd546 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.414589:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd546 expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.414608:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd546 expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607341.414617:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d000, rc 0) 00000100:00100000:0.0:1789607341.414665:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149954816:12345-0@lo:101: Request processed in 127us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.414671:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789607341.414820:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954816:0@lo:101: 00010000:00010000:3.0:1789607341.414833:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.414846:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.414921:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954944:0@lo:501: 00000100:00100000:3.0:1789607341.414945:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.414963:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607341.415217:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149954944 00000100:00100000:2.0:1789607341.415222:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149954944 00000100:00100000:2.0:1789607341.415258:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789607341.415265:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149954944:12345-0@lo:501: 00000100:00100000:2.0:1789607341.415547:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149954944:12345-0@lo:501: Request processed in 281us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.415554:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789607341.415710:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149954944:0@lo:501: 00000100:00100000:3.0:1789607341.415742:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149955072:0@lo:503: 00000100:00100000:3.0:1789607341.415787:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.415821:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.416030:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955072 00000100:00100000:0.0:1789607341.416035:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955072 00000100:00100000:0.0:1789607341.416068:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789607341.416075:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149955072:12345-0@lo:503: 00000100:00100000:0.0:1789607341.416404:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149955072:12345-0@lo:503: Request processed in 329us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.416411:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789607341.416692:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149955072:0@lo:503: 00000100:00100000:2.0:1789607341.420130:0:9389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9389:1876539149955200:0@lo:502: 00000100:00100000:2.0:1789607341.420216:0:9389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.420259:0:9389:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.420365:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955200 00000100:00100000:3.0:1789607341.420385:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955200 00000100:00100000:3.0:1789607341.420431:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789607341.420440:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:9389:x1876539149955200:12345-0@lo:502: 00000100:00100000:3.0:1789607341.420797:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:9389:x1876539149955200:12345-0@lo:502: Request processed in 357us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.420805:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789607341.421166:0:9389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9389:1876539149955200:0@lo:502: 00000020:01000000:2.0:1789607341.421200:0:9389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607341.421207:0:9389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1789607341.421215:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607341.421218:0:9389:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789607341.421223:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607341.421227:0:9389:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607341.421251:0:9389:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789607341.421261:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607341.421276:0:9389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d77c4ce4d40) 00000020:00000080:2.0:1789607341.421301:0:9389:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789607341.421308:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607341.421383:0:9389:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789607341.421391:0:9389:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789607341.421398:0:9389:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbd55b 00010000:00080000:2.0:1789607341.421437:0:9389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c4ecc000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607341.421833:0:9389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789607341.439668:0:9389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789607341.439694:0:9389:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789607341.442809:0:9389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607341.443245:0:9389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607341.443296:0:9389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789607341.443356:0:9389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789607341.464038:0:9392:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607341.464045:0:9392:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789607341.466824:0:9389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789607341.466838:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789607341.467294:0:9389:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789607341.467323:0:9389:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd562 00000100:00080000:0.0:1789607341.467334:0:9389:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607341.467346:0:9389:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d77c4ecc000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607341.472531:0:9389:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cfc7f800 x1876539149955328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607341.472665:0:9389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789607341.472773:0:9389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607341.472780:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607341.472782:0:9389:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789607341.472785:0:9389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607341.472803:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607341.472805:0:9389:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607341.472809:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607341.472811:0:9389:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789607341.472844:0:9389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9389:1876539149955456:0@lo:502: 00000100:00100000:0.0:1789607341.473136:0:9389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.473176:0:9389:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd5d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.473199:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539149955328:0@lo:8: 00000100:00100000:0.0:1789607341.473233:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.473268:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955456 00000100:00100000:0.0:1789607341.473275:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955456 00000100:00100000:0.0:1789607341.473316:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789607341.473325:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:9389:x1876539149955456:12345-0@lo:502: 00000100:00100000:0.0:1789607341.475193:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:9389:x1876539149955456:12345-0@lo:502: Request processed in 1863us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.475205:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789607341.475270:0:9389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9389:1876539149955456:0@lo:502: 00000020:01000000:0.0:1789607341.475307:0:9389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607341.475313:0:9389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607341.475316:0:9389:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789607341.475320:0:9389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1789607341.475629:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955328 00000100:00100000:3.0:1789607341.475635:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955328 00000100:00100000:3.0:1789607341.475663:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607341.475669:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539149955328:12345-0@lo:8: 00010000:00080000:3.0:1789607341.475697:0:8114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1789607341.475726:0:8114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbd569 00002000:00100000:3.0:1789607341.475739:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d77c4ba5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789607341.475743:0:8114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789607341.475747:0:8114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789607341.475857:0:8114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789607341.476056:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789607341.476088:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ba2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607341.476143:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539149955328:12345-0@lo:8: Request processed in 472us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.476151:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607341.476257:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149955584:0@lo:400: 00000100:00100000:3.0:1789607341.476294:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476319:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539149956096:0@lo:400: 00000100:00100000:3.0:1789607341.476341:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476357:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539149956608:0@lo:400: 00000100:00100000:3.0:1789607341.476390:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476410:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789607341.476415:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149955712:0@lo:400: 00000100:00100000:3.0:1789607341.476439:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476457:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149956224:0@lo:400: 00000100:00100000:3.0:1789607341.476489:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476510:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149956736:0@lo:400: 00000100:00100000:3.0:1789607341.476543:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476564:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539149955840:0@lo:400: 00000100:00100000:3.0:1789607341.476582:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476591:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149956352:0@lo:400: 00000100:00100000:3.0:1789607341.476606:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476620:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607341.476626:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149955968:0@lo:400: 00000100:00100000:3.0:1789607341.476643:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476660:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149956480:0@lo:400: 00000100:00100000:3.0:1789607341.476689:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.476716:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956352 00000100:00100000:3.0:1789607341.476720:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956352 00000100:00100000:3.0:1789607341.476750:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956480 00000100:00100000:3.0:1789607341.476753:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956480 00000100:00100000:3.0:1789607341.476769:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607341.476776:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149956352:12345-0@lo:400: 00000100:00100000:3.0:1789607341.476814:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149956352:12345-0@lo:400: Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.476820:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607341.476831:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607341.476837:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149956480:12345-0@lo:400: 00000100:00100000:3.0:1789607341.476885:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149956480:12345-0@lo:400: Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.476891:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789607341.476926:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7f800 x1876539149955328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.476937:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607341.476944:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789607341.476952:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789607341.476957:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789607341.476959:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ecc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789607341.476975:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789607341.476980:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539149955328:0@lo:8: 00000100:00100000:3.0:1789607341.477001:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955584 00000100:00100000:3.0:1789607341.477005:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955584 00000100:00100000:3.0:1789607341.477033:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956096 00000100:00100000:3.0:1789607341.477042:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956096 00000100:00100000:3.0:1789607341.477058:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956608 00000100:00100000:3.0:1789607341.477061:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956608 00000100:00100000:3.0:1789607341.477072:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956224 00000100:00100000:3.0:1789607341.477074:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956224 00000100:00100000:3.0:1789607341.477085:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956736 00000100:00100000:3.0:1789607341.477086:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956736 00000100:00100000:3.0:1789607341.477095:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955840 00000100:00100000:3.0:1789607341.477097:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955840 00000100:00100000:3.0:1789607341.477108:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607341.477113:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149955584:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477148:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149955584:12345-0@lo:400: Request processed in 34us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477153:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607341.477164:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607341.477170:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539149956096:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477195:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539149956096:12345-0@lo:400: Request processed in 26us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477200:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607341.477211:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607341.477217:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539149956608:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477239:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539149956608:12345-0@lo:400: Request processed in 23us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477244:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607341.477255:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607341.477261:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149956224:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477286:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149956224:12345-0@lo:400: Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477301:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607341.477313:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607341.477319:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149956736:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477348:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149956736:12345-0@lo:400: Request processed in 29us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477354:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607341.477364:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607341.477370:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539149955840:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477395:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539149955840:12345-0@lo:400: Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477401:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607341.477424:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955712 00000100:00100000:3.0:1789607341.477428:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955712 00000100:00100000:3.0:1789607341.477450:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149955968 00000100:00100000:3.0:1789607341.477453:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149955968 00000100:00100000:3.0:1789607341.477464:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607341.477469:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149955712:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477500:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149955712:12345-0@lo:400: Request processed in 30us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477505:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607341.477515:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607341.477520:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149955968:12345-0@lo:400: 00000100:00100000:3.0:1789607341.477544:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149955968:12345-0@lo:400: Request processed in 25us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.477550:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789607341.477573:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607341.477582:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607341.477585:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607341.477605:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149955968:0@lo:400: 00010000:00080000:3.0:1789607341.477616:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539149956480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477626:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149956480:0@lo:400: 00010000:00080000:3.0:1789607341.477635:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0e300 x1876539149955840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477642:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539149955840:0@lo:400: 00010000:00080000:3.0:1789607341.477650:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83480 x1876539149956352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477657:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149956352:0@lo:400: 00000100:00100000:3.0:1789607341.477685:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149955712:0@lo:400: 00010000:00080000:3.0:1789607341.477694:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0ce00 x1876539149956224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477702:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149956224:0@lo:400: 00010000:00080000:3.0:1789607341.477711:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc904e00 x1876539149956736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477718:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149956736:0@lo:400: 00010000:00080000:3.0:1789607341.477726:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0f800 x1876539149955584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477733:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149955584:0@lo:400: 00010000:00080000:3.0:1789607341.477742:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0ea00 x1876539149956096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477755:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539149956096:0@lo:400: 00010000:00080000:3.0:1789607341.477767:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc904700 x1876539149956608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.477774:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539149956608:0@lo:400: 00000100:00100000:1.0:1789607341.479855:0:9394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149956864:0@lo:700: 00000100:00100000:1.0:1789607341.480299:0:9394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607341.480343:0:8121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956864 00000100:00100000:1.0:1789607341.480350:0:8121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956864 00000100:00100000:1.0:1789607341.480470:0:8121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607341.480479:0:8121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9394:x1876539149956864:12345-0@lo:700: 00000100:00100000:1.0:1789607341.480721:0:8121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8121:1876539149956992:0@lo:700: 00000100:00100000:1.0:1789607341.480766:0:8121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607341.480787:0:8121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607341.480806:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149956992 00000100:00100000:1.0:1789607341.480809:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149956992 00000100:00100000:1.0:1789607341.480835:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607341.480841:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8121:x1876539149956992:12345-0@lo:700: 00000020:01000000:3.0:1789607341.481483:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789607341.481510:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789607341.481824:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.481836:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607341.481846:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789607341.481849:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c75d7000 from 39 10000000:01000000:3.0:1789607341.481851:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607341.481896:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.481904:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.481913:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.481928:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957120:0@lo:101: 00000100:00100000:3.0:1789607341.481968:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.481997:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58780 going to sleep for 11 seconds 00000100:00080000:3.0:1789607341.482027:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607341.482039:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957120 00000100:00100000:3.0:1789607341.482044:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957120 00000100:00100000:3.0:1789607341.482075:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789607341.482082:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149957120:12345-0@lo:101: 00010000:00010000:3.0:1789607341.482092:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607341.482104:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd570 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.482125:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd570 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.482135:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd570 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.482143:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0030c00, rc 0) 00000100:00100000:3.0:1789607341.482179:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149957120:12345-0@lo:101: Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.482185:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789607341.482226:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957120:0@lo:101: 00010000:00010000:3.0:1789607341.482239:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.482248:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.482294:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957248:0@lo:501: 00000100:00100000:3.0:1789607341.482317:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.482329:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.482348:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957248 00000100:00100000:3.0:1789607341.482352:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957248 00000004:00080000:2.0:1789607341.485982:0:9392:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789607341.486149:0:9392:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 246443286126ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789607341.489190:0:9394:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.489783:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789607341.489800:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149957248:12345-0@lo:501: 00000100:00100000:3.0:1789607341.490111:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149957248:12345-0@lo:501: Request processed in 316us (7791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.490119:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789607341.490271:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957248:0@lo:501: 00000100:00100000:3.0:1789607341.490321:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957376:0@lo:503: 00000100:00100000:3.0:1789607341.490365:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.491730:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.492008:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957376 00000100:00100000:0.0:1789607341.492025:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957376 00000100:00100000:0.0:1789607341.492064:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789607341.492072:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149957376:12345-0@lo:503: 00000100:00100000:0.0:1789607341.492270:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149957376:12345-0@lo:503: Request processed in 198us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607341.492278:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789607341.495613:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957376:0@lo:503: 00000100:00100000:3.0:1789607341.495924:0:9396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9396:1876539149957504:0@lo:502: 00000100:00100000:3.0:1789607341.495992:0:9396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.496042:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957504 00000100:00100000:3.0:1789607341.496048:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957504 00000100:00100000:3.0:1789607341.496100:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789607341.496110:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:9396:x1876539149957504:12345-0@lo:502: 00000100:00100000:3.0:1789607341.496597:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:9396:x1876539149957504:12345-0@lo:502: Request processed in 487us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.496605:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789607341.496655:0:9396:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.496684:0:9396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9396:1876539149957504:0@lo:502: 00000100:00100000:3.0:1789607341.496825:0:9396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9396:1876539149957632:0@lo:502: 00000100:00100000:3.0:1789607341.496882:0:9396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.496912:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957632 00000100:00100000:3.0:1789607341.496917:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957632 00000100:00100000:3.0:1789607341.496941:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789607341.496950:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:9396:x1876539149957632:12345-0@lo:502: 00000100:00100000:3.0:1789607341.497374:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:9396:x1876539149957632:12345-0@lo:502: Request processed in 425us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.497381:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789607341.497415:0:9396:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.497427:0:9396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9396:1876539149957632:0@lo:502: 00000040:00080000:3.0:1789607341.497446:0:9396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789607341.497820:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789607341.497836:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607341.497853:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.497883:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607341.497893:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607341.497896:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c75d7000 from 6 10000000:01000000:3.0:1789607341.497898:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607341.497935:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.497942:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.497951:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.497973:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957760:0@lo:101: 00000100:00100000:3.0:1789607341.498004:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.498031:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.498045:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957760 00000100:00100000:3.0:1789607341.498049:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957760 00000100:00100000:3.0:1789607341.498124:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789607341.498183:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149957760:12345-0@lo:101: 00010000:00010000:3.0:1789607341.498193:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607341.498205:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbd585 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd57e expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498222:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbd585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd57e expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498229:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbd585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd57e expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498235:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571fe00, rc 0) 00000100:00100000:3.0:1789607341.498256:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149957760:12345-0@lo:101: Request processed in 127us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.498260:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789607341.498283:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957760:0@lo:101: 00010000:00010000:3.0:1789607341.498290:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498296:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.498334:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957888:0@lo:256: 00000100:00100000:3.0:1789607341.498354:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.498363:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.498426:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149957888 00000100:00100000:3.0:1789607341.498429:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149957888 00000100:00100000:3.0:1789607341.498443:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789607341.498446:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149957888:12345-0@lo:256: 20000000:01000000:3.0:1789607341.498560:0:6463:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607341.498578:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607341.498581:0:6463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789607341.498654:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149957888:12345-0@lo:256: Request processed in 205us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.498661:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789607341.498758:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149957888:0@lo:256: 10000000:01000000:3.0:1789607341.498808:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607341.498814:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498822:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607341.498829:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789607341.498830:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789607341.498833:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789607341.498849:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498885:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.498893:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.498907:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958016:0@lo:101: 00000100:00100000:3.0:1789607341.498940:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.498966:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.498981:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958016 00000100:00100000:3.0:1789607341.498985:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958016 00000100:00100000:3.0:1789607341.499011:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789607341.499032:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149958016:12345-0@lo:101: 00010000:00010000:3.0:1789607341.499040:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607341.499050:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd58c expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.499078:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd58c expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.499091:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd58c expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.499098:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607341.499129:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149958016:12345-0@lo:101: Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.499135:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789607341.499166:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958016:0@lo:101: 00010000:00010000:3.0:1789607341.499284:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.499294:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.499333:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958144:0@lo:501: 00000100:00100000:3.0:1789607341.499351:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.499361:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.499369:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958144 00000100:00100000:3.0:1789607341.499372:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958144 00000100:00100000:3.0:1789607341.499385:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789607341.499388:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149958144:12345-0@lo:501: 00000100:00100000:3.0:1789607341.499555:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149958144:12345-0@lo:501: Request processed in 164us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.499561:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789607341.499649:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958144:0@lo:501: 00000100:00100000:3.0:1789607341.499771:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958272:0@lo:503: 00000100:00100000:3.0:1789607341.499948:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.499963:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.499976:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958272 00000100:00100000:3.0:1789607341.499980:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958272 00000100:00100000:3.0:1789607341.500003:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789607341.500010:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149958272:12345-0@lo:503: 00000100:00100000:3.0:1789607341.500542:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149958272:12345-0@lo:503: Request processed in 531us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.500550:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789607341.500596:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958272:0@lo:503: 00000100:00100000:3.0:1789607341.501641:0:9397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9397:1876539149958400:0@lo:502: 00000100:00100000:3.0:1789607341.501694:0:9397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.501726:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958400 00000100:00100000:3.0:1789607341.501731:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958400 00000100:00100000:3.0:1789607341.501759:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789607341.501767:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:9397:x1876539149958400:12345-0@lo:502: 00000100:00100000:3.0:1789607341.503008:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:9397:x1876539149958400:12345-0@lo:502: Request processed in 1237us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.503028:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789607341.503572:0:9397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.503594:0:9397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9397:1876539149958400:0@lo:502: 00000020:01000000:3.0:1789607341.503626:0:9397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607341.503632:0:9397:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789607341.503638:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607341.503640:0:9397:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789607341.503647:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789607341.503651:0:9397:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:3.0:1789607341.503671:0:9397:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789607341.503674:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607341.503688:0:9397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d78f12b4d40) 00000020:00000080:3.0:1789607341.503713:0:9397:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789607341.503719:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789607341.503795:0:9397:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789607341.503801:0:9397:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789607341.503808:0:9397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbd5a1 00010000:00080000:3.0:1789607341.504114:0:9397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78f77e3800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1789607341.504401:0:9397:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789607341.505335:0:9397:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789607341.505348:0:9397:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789607341.507669:0:9397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607341.508982:0:9397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607341.509060:0:9397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789607341.509164:0:9397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789607341.510270:0:9399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607341.510275:0:9399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789607341.535811:0:9397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607341.535826:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789607341.536977:0:9397:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789607341.537138:0:9397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd5a8 00000100:00080000:3.0:1789607341.537150:0:9397:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607341.537161:0:9397:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f77e3800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607341.537201:0:9397:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d77c5127b80 x1876539149958528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607341.537222:0:9397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789607341.537285:0:9397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607341.537290:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607341.537292:0:9397:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789607341.537295:0:9397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607341.537299:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607341.537300:0:9397:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789607341.537303:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789607341.537305:0:9397:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789607341.537330:0:9397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9397:1876539149958656:0@lo:502: 00000100:00100000:3.0:1789607341.540308:0:9397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.540348:0:9397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.540389:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539149958528:0@lo:8: 00000100:00100000:3.0:1789607341.540426:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.540490:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958528 00000100:00100000:3.0:1789607341.540497:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958528 00000100:00100000:3.0:1789607341.540529:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607341.540536:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3467:x1876539149958528:12345-0@lo:8: 00010000:00080000:3.0:1789607341.540568:0:8113:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1789607341.540600:0:8113:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbd5af 00002000:00100000:3.0:1789607341.540613:0:8113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d77c551f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789607341.540618:0:8113:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789607341.540621:0:8113:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789607341.540716:0:8113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789607341.540740:0:8113:0:(import.c:65:import_set_state_nolock()) ffff8d77c5519000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607341.540788:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539149958528:12345-0@lo:8: Request processed in 251us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.540797:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789607341.540836:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5127b80 x1876539149958528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.540847:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607341.540854:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:2.0:1789607341.541138:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958656 00000100:00100000:2.0:1789607341.541143:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958656 00000100:00100000:2.0:1789607341.541177:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789607341.541184:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:9397:x1876539149958656:12345-0@lo:502: 00000100:00080000:3.0:1789607341.541469:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789607341.541476:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789607341.541479:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789607341.541489:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789607341.541494:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539149958528:0@lo:8: 00000100:00100000:2.0:1789607341.542122:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:9397:x1876539149958656:12345-0@lo:502: Request processed in 936us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.542130:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789607341.544980:0:9397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9397:1876539149958656:0@lo:502: 00000020:01000000:3.0:1789607341.545033:0:9397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607341.545041:0:9397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607341.545051:0:9397:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789607341.545056:0:9397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789607341.545180:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789607341.545194:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789607341.545203:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.545214:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607341.545223:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789607341.545226:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78e9ee99c0 from 1 10000000:01000000:3.0:1789607341.545228:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789607341.545259:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.545267:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.545275:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.545290:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958784:0@lo:101: 00000100:00100000:3.0:1789607341.545343:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.546360:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.546508:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958784 00000100:00100000:3.0:1789607341.546517:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958784 00000100:00100000:3.0:1789607341.546566:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789607341.546575:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149958784:12345-0@lo:101: 00010000:00010000:3.0:1789607341.546588:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607341.546608:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd5b6 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.546630:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 24 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.546640:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 24 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.546648:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e800, rc 0) 00000100:00100000:3.0:1789607341.546699:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149958784:12345-0@lo:101: Request processed in 125us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.546705:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789607341.546742:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958784:0@lo:101: 00010000:00010000:3.0:1789607341.546756:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.546764:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607341.546813:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958912:0@lo:501: 00000100:00100000:3.0:1789607341.546838:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.546855:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607341.549755:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149958912 00000100:00100000:0.0:1789607341.549770:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149958912 00000100:00100000:0.0:1789607341.549830:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789607341.549839:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149958912:12345-0@lo:501: 00000100:00100000:0.0:1789607341.564591:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149958912:12345-0@lo:501: Request processed in 14742us (17740us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607341.564606:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789607341.569922:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149958912:0@lo:501: 10000000:01000000:3.0:1789607341.570088:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789607341.570098:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607341.570110:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607341.574453:0:9399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789607341.574581:0:9399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 246531717800ns, next at 0ns, rc = 0 40000000:02000000:1.0:1789607341.602768:0:6475:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1789607341.619808:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8121:x1876539149956992:12345-0@lo:700: Request processed in 138957us (139032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607341.619823:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789607341.633081:0:8121:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416ed80 x1876539149956992/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607341.633100:0:8121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8121:1876539149956992:0@lo:700: 40000000:02000000:0.0:1789607341.633114:0:8121:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1789607341.692550:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1789607341.722030:0:9400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789607341.722060:0:9400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149959168:0@lo:7: 00000100:00100000:0.0:1789607341.722127:0:9400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607341.722167:0:9400:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d941c900 going to sleep for 11 seconds 00000004:00080000:3.0:1789607341.722276:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789607341.722305:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149959040:0@lo:13: 00000100:00100000:3.0:1789607341.722334:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.722372:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959168 00000100:00100000:3.0:1789607341.722380:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959168 00000100:00100000:3.0:1789607341.722428:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607341.722437:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9400:x1876539149959168:12345-0@lo:7: 00000100:00080000:1.0:1789607341.736938:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607341.736962:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959040 00000100:00100000:1.0:1789607341.736972:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959040 00000100:00100000:1.0:1789607341.737037:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607341.737048:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539149959040:12345-0@lo:13: 00002000:00000024:1.0:1789607341.737077:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789607341.737164:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539149959040:12345-0@lo:13: Request processed in 119us (14828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607341.737171:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:3.0:1789607341.740780:0:8114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789607341.740788:0:8114:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789607341.740905:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9400:x1876539149959168:12345-0@lo:7: Request processed in 18465us (18774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.740915:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789607341.743455:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075c000 x1876539149959040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.743482:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149959040:0@lo:13: 00010000:00080000:3.0:1789607341.743523:0:9400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075e680 x1876539149959168/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.743532:0:9400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149959168:0@lo:7: 00000004:00080000:3.0:1789607341.743543:0:9400:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789607341.743577:0:9400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149959296:0@lo:5: 00000100:00100000:3.0:1789607341.743638:0:9400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.743679:0:9400:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.743697:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959296 00000100:00100000:3.0:1789607341.743717:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959296 00000100:00100000:3.0:1789607341.743761:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607341.743770:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9400:x1876539149959296:12345-0@lo:5: 00002000:00080000:3.0:1789607341.745544:0:8112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789607341.745551:0:8112:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789607341.746583:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:9400:x1876539149959296:12345-0@lo:5: Request processed in 2809us (2940us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789607341.746593:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789607341.746652:0:9400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5127b80 x1876539149959296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.746668:0:9400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149959296:0@lo:5: 00000004:00080000:3.0:1789607341.746681:0:9400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789607341.746717:0:9400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149959424:0@lo:700: 00000100:00100000:3.0:1789607341.746748:0:9400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.746772:0:9400:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0e84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.746791:0:8120:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:3.0:1789607341.746815:0:8120:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1789607341.751784:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959424 00000100:00100000:3.0:1789607341.752965:0:8120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959424 00000100:00100000:3.0:1789607341.753028:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607341.753038:0:8120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:9400:x1876539149959424:12345-0@lo:700: 00000001:00100000:3.0:1789607341.759532:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789607341.759545:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789607341.760117:0:8121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9394:x1876539149956864:12345-0@lo:700: Request processed in 279633us (279812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607341.760130:0:8121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789607341.760279:0:9394:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f7570e00 x1876539149956864/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607341.760293:0:9394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149956864:0@lo:700: 00000004:00080000:2.0:1789607341.862706:0:9394:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789607341.862737:0:9394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149959680:0@lo:7: 00000100:00100000:2.0:1789607341.862799:0:9394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.862841:0:9394:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.863564:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149959552:0@lo:13: 00000100:00100000:3.0:1789607341.863601:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.864306:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959680 00000100:00100000:3.0:1789607341.864321:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959680 00000100:00100000:3.0:1789607341.865289:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607341.865303:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9394:x1876539149959680:12345-0@lo:7: 00000100:00100000:2.0:1789607341.865493:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959552 00000100:00100000:2.0:1789607341.865500:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959552 00000100:00100000:2.0:1789607341.865530:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607341.865537:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539149959552:12345-0@lo:13: 00002000:00000024:2.0:1789607341.865551:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789607341.865823:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539149959552:12345-0@lo:13: Request processed in 285us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607341.865831:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789607341.872520:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd591c00 x1876539149959552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607341.872547:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149959552:0@lo:13: 00002000:00080000:3.0:1789607341.879027:0:8114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789607341.879035:0:8114:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789607341.879142:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9394:x1876539149959680:12345-0@lo:7: Request processed in 13838us (16338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.879154:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789607341.879231:0:9394:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd591180 x1876539149959680/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.879248:0:9394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149959680:0@lo:7: 00000004:00080000:3.0:1789607341.879262:0:9394:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789607341.879304:0:9394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149959808:0@lo:5: 00000100:00100000:3.0:1789607341.879337:0:9394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.879360:0:9394:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.879377:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959808 00000100:00100000:3.0:1789607341.879383:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959808 00000100:00100000:3.0:1789607341.879419:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607341.879427:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9394:x1876539149959808:12345-0@lo:5: 00002000:00080000:3.0:1789607341.879453:0:8113:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789607341.879483:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9394:x1876539149959808:12345-0@lo:5: Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.879489:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789607341.879515:0:9394:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5127480 x1876539149959808/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.879525:0:9394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149959808:0@lo:5: 00000004:00080000:3.0:1789607341.879534:0:9394:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789607341.879564:0:9394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149959936:0@lo:5: 00000100:00100000:3.0:1789607341.879586:0:9394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607341.879600:0:9394:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.879610:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149959936 00000100:00100000:3.0:1789607341.879613:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149959936 00000100:00100000:3.0:1789607341.879637:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607341.879642:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9394:x1876539149959936:12345-0@lo:5: 00002000:00080000:3.0:1789607341.879665:0:8114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789607341.894770:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9394:x1876539149959936:12345-0@lo:5: Request processed in 15119us (15174us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789607341.894784:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789607341.894923:0:9394:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5127480 x1876539149959936/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607341.894939:0:9394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9394:1876539149959936:0@lo:5: 00000004:00080000:2.0:1789607341.894953:0:9394:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789607341.895006:0:9394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9394:1876539149960064:0@lo:900: 00000100:00100000:2.0:1789607341.895068:0:9394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607341.895094:0:9394:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607341.896296:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960064 00000100:00100000:3.0:1789607341.896308:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960064 00000100:00100000:3.0:1789607341.896357:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607341.896374:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9394:x1876539149960064:12345-0@lo:900: 00000100:00100000:3.0:1789607341.896448:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9394:x1876539149960064:12345-0@lo:900: Request processed in 82us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.896454:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789607341.896493:0:9394:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd591c00 x1876539149960064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.896504:0:9394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9394:1876539149960064:0@lo:900: 00000001:00080000:0.0:1789607341.978948:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1789607341.986573:0:8120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9400:x1876539149959424:12345-0@lo:700: Request processed in 233528us (239815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607341.986587:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789607341.986653:0:9400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5125880 x1876539149959424/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789607357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607341.986679:0:9400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789607341.986697:0:9400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149959424:0@lo:700: 00000004:02000040:3.0:1789607342.149499:0:9400:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789607342.187182:0:9400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149960192:0@lo:5: 00000100:00100000:1.0:1789607342.187253:0:9400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607342.187304:0:9400:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607342.187324:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960192 00000100:00100000:1.0:1789607342.187332:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960192 00000100:00100000:1.0:1789607342.187381:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607342.187391:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9400:x1876539149960192:12345-0@lo:5: 00000001:02000400:0.0:1789607342.196468:0:9429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00002000:00080000:1.0:1789607342.201904:0:8112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789607342.201923:0:8112:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1789607342.215667:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9400:x1876539149960192:12345-0@lo:5: Request processed in 28271us (28407us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789607342.215687:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789607342.216094:0:9400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5bd1c00 x1876539149960192/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607358 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607342.216113:0:9400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9400:1876539149960192:0@lo:5: 00000004:00080000:3.0:1789607342.216127:0:9400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789607342.306151:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607343.334204:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607343.851338:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149960320:0@lo:13: 00000100:00100000:1.0:1789607343.851407:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607343.851746:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149960448:0@lo:13: 00000100:00100000:3.0:1789607343.851777:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607343.851814:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960320 00000100:00100000:3.0:1789607343.851821:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960320 00000100:00100000:3.0:1789607343.851877:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960448 00000100:00100000:3.0:1789607343.851881:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960448 00000100:00100000:3.0:1789607343.851900:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607343.851907:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149960320:12345-0@lo:13: 00002000:00000024:3.0:1789607343.851940:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607343.852003:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149960320:12345-0@lo:13: Request processed in 88us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607343.852010:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607343.852025:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607343.852031:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149960448:12345-0@lo:13: 00002000:00000024:3.0:1789607343.852051:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607343.852078:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149960448:12345-0@lo:13: Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607343.852097:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789607343.852113:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607343.852140:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5125880 x1876539149960448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607343.852413:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149960448:0@lo:13: 00010000:00080000:1.0:1789607343.854521:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facbca80 x1876539149960320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607343.854544:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149960320:0@lo:13: 00010000:00010000:0.0:1789607344.354176:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607344.354396:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149960576:0@lo:41: 00000100:00100000:3.0:1789607344.354476:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607344.354578:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960576 00000100:00100000:1.0:1789607344.354586:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960576 00000100:00100000:1.0:1789607344.354635:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789607344.354644:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149960576:12345-0@lo:41: 00000004:00000024:1.0:1789607344.354683:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607344.354738:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149960576:12345-0@lo:41: Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607344.354745:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789607344.354816:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149960576:0@lo:41: 00000100:00100000:0.0:1789607344.867372:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149960704:0@lo:41: 00000100:00100000:0.0:1789607344.867448:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607344.867897:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960704 00000100:00100000:2.0:1789607344.867906:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960704 00000100:00100000:2.0:1789607344.867956:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607344.867974:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149960704:12345-0@lo:41: 00000004:00000024:2.0:1789607344.868022:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607344.868086:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149960704:12345-0@lo:41: Request processed in 122us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607344.868104:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607344.868281:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149960704:0@lo:41: 00010000:00010000:0.0:1789607345.380255:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607346.402389:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607346.914126:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149960832:0@lo:400: 00000100:00100000:0.0:1789607346.914239:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607346.918440:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607346.919412:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149960960:0@lo:400: 00000100:00100000:0.0:1789607346.919619:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607346.919803:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960832 00000100:00100000:3.0:1789607346.919987:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149960960 00000100:00100000:3.0:1789607346.919994:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960960 00000100:00100000:0.0:1789607346.920544:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149960832 00000100:00100000:0.0:1789607346.920595:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789607346.920606:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149960832:12345-0@lo:400: 00000100:00100000:1.0:1789607346.920636:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607346.920651:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149961088:0@lo:13: 00000100:00100000:0.0:1789607346.920677:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149960832:12345-0@lo:400: Request processed in 74us (6440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607346.920685:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789607346.920688:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.923000:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607346.923020:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149960960:12345-0@lo:400: 00000100:00100000:3.0:1789607346.923130:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149960960:12345-0@lo:400: Request processed in 118us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.923138:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607346.923232:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607346.923247:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149961216:0@lo:13: 00000100:00100000:3.0:1789607346.923284:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.923324:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961088 00000100:00100000:3.0:1789607346.923332:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961088 00000100:00100000:3.0:1789607346.923365:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961216 00000100:00100000:3.0:1789607346.923368:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961216 00000100:00100000:3.0:1789607346.923381:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607346.923386:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539149961088:12345-0@lo:13: 00002000:00000024:3.0:1789607346.923416:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607346.923451:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539149961088:12345-0@lo:13: Request processed in 65us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.923472:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607346.923686:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607346.923695:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3468:x1876539149961216:12345-0@lo:13: 00002000:00000024:3.0:1789607346.923706:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607346.923738:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3468:x1876539149961216:12345-0@lo:13: Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.923744:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789607346.928453:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5bd3100 x1876539149961088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.928550:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149961088:0@lo:13: 00000100:00080000:3.0:1789607346.928600:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607346.928632:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075e680 x1876539149961216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.928647:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149961216:0@lo:13: 00010000:00080000:3.0:1789607346.941132:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5125f80 x1876539149960960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.941156:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149960960:0@lo:400: 00000100:00100000:3.0:1789607346.941171:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149960832:0@lo:400: 00000100:00100000:3.0:1789607346.941274:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149961344:0@lo:400: 00000100:00100000:3.0:1789607346.941716:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.941965:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961344 00000100:00100000:3.0:1789607346.941982:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961344 00000100:00100000:3.0:1789607346.942045:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607346.942056:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149961344:12345-0@lo:400: 00000100:00100000:3.0:1789607346.942149:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149961344:12345-0@lo:400: Request processed in 94us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.942157:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607346.942199:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149961344:0@lo:400: 00000100:00100000:3.0:1789607346.942309:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149961472:0@lo:400: 00000100:00100000:3.0:1789607346.942342:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.942379:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961472 00000100:00100000:3.0:1789607346.942383:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961472 00000100:00100000:3.0:1789607346.942411:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607346.942418:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149961472:12345-0@lo:400: 00000100:00100000:3.0:1789607346.943007:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149961472:12345-0@lo:400: Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.943015:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789607346.943067:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5125f80 x1876539149961472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.943079:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149961472:0@lo:400: 00000100:00100000:3.0:1789607346.943147:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149961600:0@lo:400: 00000100:00100000:3.0:1789607346.943181:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.943331:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149961728:0@lo:400: 00000100:00100000:3.0:1789607346.943360:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.943391:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961728 00000100:00100000:3.0:1789607346.943395:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961728 00000100:00100000:3.0:1789607346.943436:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607346.943443:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149961728:12345-0@lo:400: 00000100:00100000:3.0:1789607346.943565:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149961728:12345-0@lo:400: Request processed in 122us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.943579:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789607346.943596:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789607346.943633:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc904e00 x1876539149961728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.943646:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149961728:0@lo:400: 00000100:00100000:3.0:1789607346.943685:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149961856:0@lo:400: 00000100:00100000:3.0:1789607346.943726:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.943992:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961856 00000100:00100000:3.0:1789607346.943997:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961856 00000100:00100000:3.0:1789607346.944026:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607346.944034:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149961856:12345-0@lo:400: 00000100:00100000:3.0:1789607346.944072:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149961856:12345-0@lo:400: Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.944080:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789607346.944109:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789607346.944128:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539149961856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.944139:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149961856:0@lo:400: 00000100:00100000:3.0:1789607346.944170:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149961984:0@lo:400: 00000100:00100000:3.0:1789607346.944198:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.944228:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961984 00000100:00100000:3.0:1789607346.944232:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961984 00000100:00100000:3.0:1789607346.944352:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607346.944359:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149961984:12345-0@lo:400: 00000100:00100000:3.0:1789607346.944394:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149961984:12345-0@lo:400: Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.944408:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789607346.944423:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607346.944439:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539149961984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.944447:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149961984:0@lo:400: 00000100:00100000:3.0:1789607346.944554:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149962112:0@lo:400: 00000100:00100000:3.0:1789607346.944579:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.944623:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149962240:0@lo:400: 00000100:00100000:3.0:1789607346.944646:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.944702:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962240 00000100:00100000:3.0:1789607346.944706:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962240 00000100:00100000:3.0:1789607346.944732:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607346.944757:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149962240:12345-0@lo:400: 00000100:00100000:3.0:1789607346.944797:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149962240:12345-0@lo:400: Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.944802:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789607346.945311:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789607346.945341:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0d880 x1876539149962240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.945353:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149962240:0@lo:400: 00000100:00100000:3.0:1789607346.945396:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149962368:0@lo:400: 00000100:00100000:3.0:1789607346.945424:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607346.945454:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962368 00000100:00100000:3.0:1789607346.945459:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962368 00000100:00100000:3.0:1789607346.945567:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607346.945581:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149962368:12345-0@lo:400: 00000100:00100000:3.0:1789607346.945615:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149962368:12345-0@lo:400: Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.945621:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789607346.945636:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789607346.945652:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0d880 x1876539149962368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607346.945661:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149962368:0@lo:400: 00000100:00100000:3.0:1789607346.945719:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149961600 00000100:00100000:3.0:1789607346.945724:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149961600 00000100:00100000:3.0:1789607346.945904:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607346.946151:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149961600:12345-0@lo:400: 00000100:00100000:3.0:1789607346.946197:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149961600:12345-0@lo:400: Request processed in 50us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607346.946204:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607346.946539:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149961600:0@lo:400: 00000100:00100000:2.0:1789607346.947077:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962112 00000100:00100000:2.0:1789607346.947085:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962112 00000100:00100000:2.0:1789607346.947147:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607346.947155:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149962112:12345-0@lo:400: 00000100:00100000:2.0:1789607346.947211:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149962112:12345-0@lo:400: Request processed in 58us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607346.947217:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789607346.947237:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789607346.947262:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0f800 x1876539149962112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607346.948077:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149962112:0@lo:400: 00000001:00080000:0.0:1789607347.089199:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1789607347.089224:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789607347.429499:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607348.450282:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607348.967437:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149962496:0@lo:13: 00000100:00100000:0.0:1789607348.967555:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607348.967732:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962496 00000100:00100000:2.0:1789607348.967746:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962496 00000100:00100000:2.0:1789607348.967830:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789607348.967843:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149962496:12345-0@lo:13: 00002000:00000024:2.0:1789607348.967904:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607348.968002:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149962496:12345-0@lo:13: Request processed in 163us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607348.968009:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789607348.968185:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607348.968231:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facbdf80 x1876539149962496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607348.968255:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149962496:0@lo:13: 00000100:00100000:0.0:1789607348.973276:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149962624:0@lo:13: 00000100:00100000:0.0:1789607348.973380:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607348.974497:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962624 00000100:00100000:3.0:1789607348.974512:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962624 00000100:00100000:3.0:1789607348.974566:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607348.974575:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149962624:12345-0@lo:13: 00002000:00000024:3.0:1789607348.974613:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607348.974687:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149962624:12345-0@lo:13: Request processed in 114us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607348.974694:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789607348.974720:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607348.976221:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facbdf80 x1876539149962624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607348.976254:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149962624:0@lo:13: 00000100:00100000:3.0:1789607349.364849:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.364991:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987200 00000100:00100000:3.0:1789607349.365004:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987200 00000100:00100000:3.0:1789607349.365072:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 181 00000100:00100000:3.0:1789607349.365082:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1876539129987200:12345-192.168.203.25@tcp:250: 00010000:00080000:3.0:1789607349.365118:0:6462:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b814cb5b-bf81-4b03-a60b-45a9a573a4b8@192.168.203.25@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1789607349.365159:0:6462:0:(genops.c:1384:class_connect()) connect: client b814cb5b-bf81-4b03-a60b-45a9a573a4b8, cookie 0xa26202d240fbd5c4 00000100:00080000:2.0:1789607349.365928:0:6462:0:(import.c:65:import_set_state_nolock()) ffff8d77c551e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607349.366031:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+5:2392:x1876539129987200:12345-192.168.203.25@tcp:250: Request processed in 948us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607349.366042:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 181 00000100:00100000:3.0:1789607349.373984:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607349.377527:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987328 00000100:00100000:0.0:1789607349.377569:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987328 00000100:00100000:0.0:1789607349.377642:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 182 00000100:00100000:0.0:1789607349.377654:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+5:6359:x1876539129987328:12345-192.168.203.25@tcp:101: 00010000:00010000:0.0:1789607349.377675:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607349.377699:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668757 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607349.377737:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 6 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607349.377749:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 6 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607349.377760:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d600, rc 0) 00000100:00100000:0.0:1789607349.377840:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+6:6359:x1876539129987328:12345-192.168.203.25@tcp:101: Request processed in 189us (3871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607349.377848:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 182 00000100:00100000:2.0:1789607349.420790:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607349.421091:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987456 00000100:00100000:1.0:1789607349.421105:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987456 00000100:00100000:1.0:1789607349.421187:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 183 00000100:00100000:1.0:1789607349.421200:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+6:6359:x1876539129987456:12345-192.168.203.25@tcp:501: 00000100:00100000:1.0:1789607349.421685:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+6:6359:x1876539129987456:12345-192.168.203.25@tcp:501: Request processed in 486us (909us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607349.421696:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 183 00000100:00100000:2.0:1789607349.441391:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.441681:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987584 00000100:00100000:3.0:1789607349.441695:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987584 00000100:00100000:3.0:1789607349.441769:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:3.0:1789607349.441781:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+6:6359:x1876539129987584:12345-192.168.203.25@tcp:101: 00010000:00010000:3.0:1789607349.441804:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607349.441836:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66875e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607349.441898:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 7 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607349.441913:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 7 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607349.441924:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607349.442016:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+7:6359:x1876539129987584:12345-192.168.203.25@tcp:101: Request processed in 238us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.442024:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:0.0:1789607349.448054:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.448370:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987712 00000100:00100000:3.0:1789607349.448384:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987712 00000100:00100000:3.0:1789607349.448456:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:3.0:1789607349.448487:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+7:6359:x1876539129987712:12345-192.168.203.25@tcp:501: 00000100:00100000:3.0:1789607349.448909:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6359:x1876539129987712:12345-192.168.203.25@tcp:501: Request processed in 422us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.448919:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:0.0:1789607349.452837:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607349.452986:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987840 00000100:00100000:2.0:1789607349.453000:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987840 00000100:00100000:2.0:1789607349.453061:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 186 00000100:00100000:2.0:1789607349.453073:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6359:x1876539129987840:12345-192.168.203.25@tcp:503: 00000100:00100000:2.0:1789607349.453739:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6359:x1876539129987840:12345-192.168.203.25@tcp:503: Request processed in 664us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607349.453749:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 186 00000100:00100000:0.0:1789607349.464304:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607349.466555:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129987968 00000100:00100000:1.0:1789607349.466575:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129987968 00000100:00100000:1.0:1789607349.466665:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 187 00000100:00100000:1.0:1789607349.466677:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6377:x1876539129987968:12345-192.168.203.25@tcp:502: 00000100:00100000:1.0:1789607349.471742:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6377:x1876539129987968:12345-192.168.203.25@tcp:502: Request processed in 550us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607349.471764:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 187 00010000:00010000:2.0:1789607349.474299:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607349.474308:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607349.474334:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149962752:0@lo:41: 00000100:00100000:3.0:1789607349.474399:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607349.474458:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962752 00000100:00100000:3.0:1789607349.474465:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962752 00000100:00100000:3.0:1789607349.474525:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607349.474533:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149962752:12345-0@lo:41: 00000004:00000024:3.0:1789607349.474568:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607349.475058:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149962752:12345-0@lo:41: Request processed in 524us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.475068:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607349.475102:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149962752:0@lo:41: 00000100:00100000:3.0:1789607349.540920:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.541131:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988096 00000100:00100000:3.0:1789607349.541141:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988096 00000100:00100000:3.0:1789607349.541265:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:3.0:1789607349.541277:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6377:x1876539129988096:12345-192.168.203.25@tcp:502: 00000100:00100000:3.0:1789607349.541595:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6377:x1876539129988096:12345-192.168.203.25@tcp:502: Request processed in 320us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.541603:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:0.0:1789607349.547014:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607349.547097:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988224 00000100:00100000:2.0:1789607349.547107:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988224 00000100:00100000:2.0:1789607349.547160:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:2.0:1789607349.547171:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6359:x1876539129988224:12345-192.168.203.25@tcp:101: 00010000:00010000:2.0:1789607349.547188:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607349.547220:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59ce00/0xa26202d240fbd5d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66878f expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607349.547256:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59ce00/0xa26202d240fbd5d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66878f expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607349.547267:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59ce00/0xa26202d240fbd5d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66878f expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607349.547276:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59ce00, rc 0) 00000100:00100000:2.0:1789607349.547341:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6359:x1876539129988224:12345-192.168.203.25@tcp:101: Request processed in 171us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607349.547348:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:3.0:1789607349.563686:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607349.563794:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988352 00000100:00100000:0.0:1789607349.563805:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988352 00000100:00100000:0.0:1789607349.563885:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:0.0:1789607349.563896:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6359:x1876539129988352:12345-192.168.203.25@tcp:256: 20000000:01000000:0.0:1789607349.563923:0:6463:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789607349.563968:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789607349.563973:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789607349.563981:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789607349.563984:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789607349.563986:0:6463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789607349.566705:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6359:x1876539129988352:12345-192.168.203.25@tcp:256: Request processed in 2797us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.566734:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:0.0:1789607349.569801:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.569977:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988480 00000100:00100000:3.0:1789607349.569988:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988480 00000100:00100000:3.0:1789607349.570568:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:3.0:1789607349.570579:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6359:x1876539129988480:12345-192.168.203.25@tcp:101: 00010000:00010000:3.0:1789607349.570596:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607349.570614:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668796 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607349.570642:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 10 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607349.570654:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 10 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607349.570662:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e600, rc 0) 00000100:00100000:3.0:1789607349.570711:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6359:x1876539129988480:12345-192.168.203.25@tcp:101: Request processed in 134us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.570718:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:0.0:1789607349.578643:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607349.578795:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988608 00000100:00100000:0.0:1789607349.578806:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988608 00000100:00100000:0.0:1789607349.578875:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 192 00000100:00100000:0.0:1789607349.578887:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6359:x1876539129988608:12345-192.168.203.25@tcp:501: 00000100:00100000:0.0:1789607349.579369:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6359:x1876539129988608:12345-192.168.203.25@tcp:501: Request processed in 483us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607349.579378:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 192 00000100:00100000:0.0:1789607349.584326:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.584401:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988736 00000100:00100000:3.0:1789607349.584412:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988736 00000100:00100000:3.0:1789607349.584461:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00100000:3.0:1789607349.584473:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6359:x1876539129988736:12345-192.168.203.25@tcp:503: 00000100:00100000:3.0:1789607349.584896:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6359:x1876539129988736:12345-192.168.203.25@tcp:503: Request processed in 425us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.584905:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00100000:2.0:1789607349.588706:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.588891:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988864 00000100:00100000:3.0:1789607349.588906:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988864 00000100:00100000:3.0:1789607349.589054:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 194 00000100:00100000:3.0:1789607349.589064:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6384:x1876539129988864:12345-192.168.203.25@tcp:502: 00000100:00100000:3.0:1789607349.589531:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6384:x1876539129988864:12345-192.168.203.25@tcp:502: Request processed in 467us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.589541:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 194 00000100:00100000:3.0:1789607349.593299:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607349.593496:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129988992 00000100:00100000:0.0:1789607349.593507:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129988992 00000100:00100000:0.0:1789607349.593855:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:0.0:1789607349.593883:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6384:x1876539129988992:12345-192.168.203.25@tcp:502: 00000100:00100000:0.0:1789607349.594122:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6384:x1876539129988992:12345-192.168.203.25@tcp:502: Request processed in 258us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607349.594131:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:1.0:1789607349.598532:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.598597:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989120 00000100:00100000:3.0:1789607349.598607:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989120 00000100:00100000:3.0:1789607349.598658:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1789607349.598666:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876539129989120:12345-192.168.203.25@tcp:38: 00010000:00080000:3.0:1789607349.598696:0:7709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1789607349.598748:0:7709:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbd5e7 00000004:00100000:3.0:1789607349.598777:0:7709:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789607349.600125:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607349.600259:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989376 00000100:00100000:3.0:1789607349.600268:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989376 00000100:00100000:3.0:1789607349.600343:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:3.0:1789607349.600350:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876539129989376:12345-192.168.203.25@tcp:38: 00010000:00080000:3.0:1789607349.600377:0:6469:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1789607349.600421:0:6469:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbd5ee 00000004:00100000:3.0:1789607349.600444:0:6469:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789607349.600521:0:7709:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ec9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607349.600581:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539129989120:12345-192.168.203.25@tcp:38: Request processed in 1914us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607349.600590:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00080000:3.0:1789607349.600692:0:6469:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607349.600724:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539129989376:12345-192.168.203.25@tcp:38: Request processed in 373us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607349.600730:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:3.0:1789607349.987717:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149962880:0@lo:41: 00000100:00100000:3.0:1789607349.987802:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607349.987939:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149962880 00000100:00100000:1.0:1789607349.987947:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149962880 00000100:00100000:1.0:1789607349.988017:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607349.988026:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149962880:12345-0@lo:41: 00000004:00000024:1.0:1789607349.988065:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607349.988114:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149962880:12345-0@lo:41: Request processed in 90us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607349.988120:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607349.988219:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149962880:0@lo:41: 00010000:00010000:1.0:1789607350.502476:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607350.613232:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607350.613268:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607350.613301:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607350.613390:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989504 00000100:00100000:2.0:1789607350.613400:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989504 00000100:00100000:2.0:1789607350.613494:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989248 00000100:00100000:2.0:1789607350.613498:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989248 00000100:00100000:2.0:1789607350.613514:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989632 00000100:00100000:2.0:1789607350.613516:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989632 00000100:00100000:2.0:1789607350.613531:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607350.613540:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:0:x1876539129989504:12345-192.168.203.25@tcp:41: 00000004:00000024:2.0:1789607350.613584:0:7709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607350.613641:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:0:x1876539129989504:12345-192.168.203.25@tcp:41: Request processed in 101us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607350.613647:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607350.613666:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1789607350.613672:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:0:x1876539129989248:12345-192.168.203.25@tcp:41: 00000004:00000024:2.0:1789607350.613690:0:7709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607350.613714:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:0:x1876539129989248:12345-192.168.203.25@tcp:41: Request processed in 42us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607350.613721:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1789607350.613733:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1789607350.613740:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129989632:12345-192.168.203.25@tcp:41: 00000004:00000024:2.0:1789607350.613750:0:7709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607350.613769:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129989632:12345-192.168.203.25@tcp:41: Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607350.613788:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00080000:1.0:1789607350.614773:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607350.614779:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607350.622512:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607350.623059:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989760 00000100:00100000:3.0:1789607350.623069:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989760 00000100:00100000:3.0:1789607350.623135:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1789607350.623145:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129989760:12345-192.168.203.25@tcp:40: 00000100:00100000:3.0:1789607350.623237:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129989760:12345-192.168.203.25@tcp:40: Request processed in 94us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607350.623245:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1789607350.627673:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607350.627713:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607350.627788:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129989888 00000100:00100000:3.0:1789607350.627798:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129989888 00000100:00100000:3.0:1789607350.627839:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990016 00000100:00100000:3.0:1789607350.627842:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990016 00000100:00100000:3.0:1789607350.627855:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607350.627887:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876539129989888:12345-192.168.203.25@tcp:8: 00010000:00080000:3.0:1789607350.627920:0:8114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1789607350.627961:0:8114:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbd5f5 00002000:00100000:3.0:1789607350.627972:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8/ffff8d78f77e4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607350.627994:0:8114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789607350.628321:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789607350.628349:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607350.628409:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539129989888:12345-192.168.203.25@tcp:8: Request processed in 545us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607350.628707:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607350.628728:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:3.0:1789607350.628733:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876539129990016:12345-192.168.203.25@tcp:8: 00010000:00080000:3.0:1789607350.628766:0:8114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1789607350.628783:0:8114:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbd5fc 00002000:00100000:3.0:1789607350.628789:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8/ffff8d78f77e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607350.628804:0:8114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789607350.629280:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789607350.629300:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ba7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607350.629444:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539129990016:12345-192.168.203.25@tcp:8: Request processed in 708us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607350.629453:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1789607350.639679:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607350.639789:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990144 00000100:00100000:3.0:1789607350.639800:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990144 00000100:00100000:3.0:1789607350.639892:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1789607350.639904:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129990144:12345-192.168.203.25@tcp:900: 00000100:00100000:3.0:1789607350.639987:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129990144:12345-192.168.203.25@tcp:900: Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607350.639994:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607350.643721:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607350.645067:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990272 00000100:00100000:3.0:1789607350.645079:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990272 00000100:00100000:3.0:1789607350.645154:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 196 00000100:00100000:3.0:1789607350.645165:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129990272:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607350.645238:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129990272:12345-192.168.203.25@tcp:400: Request processed in 74us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607350.645245:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 196 00000100:00100000:0.0:1789607350.649341:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607350.649445:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990400 00000100:00100000:1.0:1789607350.649455:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990400 00000100:00100000:1.0:1789607350.649519:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607350.649530:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129990400:12345-192.168.203.25@tcp:33: 00000004:00080000:1.0:1789607350.679586:0:6471:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29967us 00000004:00200000:2.0:1789607350.727550:0:6471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607350.727651:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6359:x1876539129990400:12345-192.168.203.25@tcp:33: Request processed in 78117us (78313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607350.727664:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1789607350.950656:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607350.950772:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990528 00000100:00100000:3.0:1789607350.950782:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990528 00000100:00100000:3.0:1789607350.950853:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1789607350.950888:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6402:x1876539129990528:12345-192.168.203.25@tcp:101: 00010000:00010000:3.0:1789607350.950908:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607350.950961:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6687c7 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607350.951030:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd60a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607350.951043:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607350.951057:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607350.951090:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607350.951093:0:6468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607350.951125:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607350.951149:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687c7 expref: 8 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607350.951168:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd60a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687c7 expref: 7 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607350.951176:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83200) 00010000:00010000:3.0:1789607350.951179:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607350.951182:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ee00, rc 0) 00000100:00100000:3.0:1789607350.951402:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:6402:x1876539129990528:12345-192.168.203.25@tcp:101: Request processed in 539us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607350.951415:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000001:00100000:2.0:1789607351.099473:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00010000:00010000:0.0:1789607351.522170:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607352.034233:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149963392:0@lo:400: 00000100:00100000:3.0:1789607352.034308:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607352.034381:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149963904:0@lo:400: 00000100:00100000:3.0:1789607352.034409:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607352.034550:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963392 00000100:00100000:3.0:1789607352.034556:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963392 00000100:00100000:0.0:1789607352.034561:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149963008:0@lo:400: 00000100:00100000:0.0:1789607352.034598:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607352.034612:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607352.034622:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149963392:12345-0@lo:400: 00000100:00100000:0.0:1789607352.034631:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149963520:0@lo:400: 00000100:00100000:0.0:1789607352.034661:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607352.034674:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149963392:12345-0@lo:400: Request processed in 53us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607352.034681:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607352.034699:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149964032:0@lo:400: 00000100:00100000:0.0:1789607352.034721:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607352.034735:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149964544:0@lo:400: 00000100:00100000:0.0:1789607352.034753:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607352.034789:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963008 00000100:00100000:0.0:1789607352.034793:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963008 00000100:00100000:0.0:1789607352.034820:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789607352.034826:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149963008:12345-0@lo:400: 00000100:00100000:0.0:1789607352.034873:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149963008:12345-0@lo:400: Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.034881:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789607352.034906:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963520 00000100:00100000:0.0:1789607352.034910:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963520 00000100:00100000:0.0:1789607352.034930:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607352.034950:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149963520:12345-0@lo:400: 00000100:00100000:0.0:1789607352.034981:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149963520:12345-0@lo:400: Request processed in 45us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.034987:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607352.035005:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963904 00000100:00100000:0.0:1789607352.035008:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963904 00000100:00100000:0.0:1789607352.035030:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964032 00000100:00100000:0.0:1789607352.035033:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964032 00000100:00100000:0.0:1789607352.035056:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964544 00000100:00100000:0.0:1789607352.035059:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964544 00000100:00100000:3.0:1789607352.035069:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607352.035090:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149963904:12345-0@lo:400: 00000100:00100000:3.0:1789607352.035120:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149963904:12345-0@lo:400: Request processed in 34us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607352.035192:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149963136:0@lo:400: 00000100:00100000:1.0:1789607352.035217:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035237:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149963648:0@lo:400: 00000100:00100000:1.0:1789607352.035252:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035265:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149964160:0@lo:400: 00000100:00100000:1.0:1789607352.035291:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035304:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149964672:0@lo:13: 00000100:00100000:1.0:1789607352.035321:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035336:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789607352.035341:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149963264:0@lo:400: 00000100:00100000:1.0:1789607352.035360:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035375:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149963776:0@lo:400: 00000100:00100000:1.0:1789607352.035391:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035403:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149964288:0@lo:400: 00000100:00100000:1.0:1789607352.035421:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035428:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149964800:0@lo:13: 00000100:00100000:1.0:1789607352.035444:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607352.035471:0:8112:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789607352.035479:0:8112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789607352.035496:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963264 00000100:00100000:1.0:1789607352.035499:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963264 00000100:00100000:0.0:1789607352.036030:0:8114:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607352.036042:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607352.036050:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149964032:12345-0@lo:400: 00000100:00100000:0.0:1789607352.036095:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149964032:12345-0@lo:400: Request processed in 47us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.036102:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607352.036113:0:8114:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607352.036120:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607352.036125:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149964544:12345-0@lo:400: 00000100:00100000:0.0:1789607352.036152:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149964544:12345-0@lo:400: Request processed in 27us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.036157:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607352.036191:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149963008:0@lo:400: 00000100:00100000:0.0:1789607352.036204:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149963520:0@lo:400: 00010000:00080000:0.0:1789607352.036216:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901377b80 x1876539149964032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607352.036225:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149964032:0@lo:400: 00010000:00080000:0.0:1789607352.036235:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901375880 x1876539149964544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607352.036242:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789607352.036255:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149964544:0@lo:400: 00000100:00100000:0.0:1789607352.037801:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789607352.037817:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149963264:12345-0@lo:400: 00000100:00100000:0.0:1789607352.038159:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149963264:12345-0@lo:400: Request processed in 347us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.038168:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789607352.038198:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963136 00000100:00100000:0.0:1789607352.038206:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963136 00000100:00100000:0.0:1789607352.038232:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963648 00000100:00100000:0.0:1789607352.038235:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963648 00000100:00100000:0.0:1789607352.038252:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964160 00000100:00100000:0.0:1789607352.038255:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964160 00000100:00100000:0.0:1789607352.038268:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149963776 00000100:00100000:0.0:1789607352.038271:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149963776 00000100:00100000:0.0:1789607352.038283:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964288 00000100:00100000:0.0:1789607352.039054:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964288 00000100:00100000:0.0:1789607352.039086:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607352.039093:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149963136:12345-0@lo:400: 00000100:00100000:0.0:1789607352.039147:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149963136:12345-0@lo:400: Request processed in 54us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.039153:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607352.039168:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789607352.039175:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149963648:12345-0@lo:400: 00000100:00100000:0.0:1789607352.039201:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149963648:12345-0@lo:400: Request processed in 28us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.039206:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789607352.039217:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607352.039222:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149964160:12345-0@lo:400: 00000100:00100000:0.0:1789607352.039246:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149964160:12345-0@lo:400: Request processed in 24us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.039252:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607352.039276:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607352.039281:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149963776:12345-0@lo:400: 00000100:00100000:3.0:1789607352.040075:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607352.040192:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607352.040204:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149964288:12345-0@lo:400: 00000100:00100000:0.0:1789607352.040239:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149963776:12345-0@lo:400: Request processed in 955us (4844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607352.040247:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607352.040254:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149964288:12345-0@lo:400: Request processed in 53us (4830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607352.040263:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789607352.040271:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607352.040276:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607352.040279:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607352.040281:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607352.040302:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964672 00000100:00100000:3.0:1789607352.040307:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964672 00000100:00100000:3.0:1789607352.040331:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964800 00000100:00100000:3.0:1789607352.040334:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964800 00000100:00100000:3.0:1789607352.040360:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607352.040366:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149964672:12345-0@lo:13: 00002000:00000024:3.0:1789607352.040382:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607352.040415:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149964672:12345-0@lo:13: Request processed in 49us (5092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607352.040421:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607352.040434:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789607352.040439:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149964800:12345-0@lo:13: 00002000:00000024:3.0:1789607352.040450:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607352.040475:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149964800:12345-0@lo:13: Request processed in 36us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607352.040480:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789607352.040902:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901375c00 x1876539149963904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607352.040916:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149963904:0@lo:400: 00000100:00100000:3.0:1789607352.040926:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149964416:0@lo:400: 00000100:00100000:3.0:1789607352.040970:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607352.041016:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149963392:0@lo:400: 00000100:00100000:3.0:1789607352.041033:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964416 00000100:00100000:3.0:1789607352.041037:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964416 00000100:00100000:3.0:1789607352.041056:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607352.041062:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149964416:12345-0@lo:400: 00000100:00080000:0.0:1789607352.041459:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607352.041510:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149963264:0@lo:400: 00010000:00080000:0.0:1789607352.041525:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901375180 x1876539149963776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607352.041535:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149963776:0@lo:400: 00010000:00080000:0.0:1789607352.041552:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901377100 x1876539149964288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607352.041559:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149964288:0@lo:400: 00010000:00080000:0.0:1789607352.041570:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5bd0380 x1876539149964800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607352.041585:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149964800:0@lo:13: 00000100:00100000:0.0:1789607352.041598:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149963136:0@lo:400: 00000100:00100000:0.0:1789607352.041608:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149963648:0@lo:400: 00000100:00100000:0.0:1789607352.041618:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149964160:0@lo:400: 00010000:00080000:0.0:1789607352.041627:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0701c00 x1876539149964672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607352.041641:0:3468:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789607352.041655:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149964672:0@lo:13: 00000100:00100000:3.0:1789607352.044980:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149964416:12345-0@lo:400: Request processed in 3909us (4001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607352.044992:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789607352.045970:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901374e00 x1876539149964416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607352.045988:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149964416:0@lo:400: 00000001:00100000:1.0:1789607352.144315:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00010000:00010000:0.0:1789607352.547469:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789607352.642325:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000100:00100000:0.0:1789607353.404987:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607353.405125:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990656 00000100:00100000:2.0:1789607353.405136:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990656 00000100:00100000:2.0:1789607353.405215:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1789607353.405227:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6454:x1876539129990656:12345-192.168.203.25@tcp:41: 00000004:00000024:2.0:1789607353.405272:0:6469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607353.405345:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6454:x1876539129990656:12345-192.168.203.25@tcp:41: Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607353.405352:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00080000:0.0:1789607353.405961:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607353.432737:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607353.432834:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990784 00000100:00100000:3.0:1789607353.432844:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990784 00000100:00100000:3.0:1789607353.432965:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607353.432976:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:6454:x1876539129990784:12345-192.168.203.25@tcp:41: 00000004:00000024:3.0:1789607353.433017:0:7709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607353.433098:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:6454:x1876539129990784:12345-192.168.203.25@tcp:41: Request processed in 124us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607353.433105:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00080000:0.0:1789607353.433724:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607353.444979:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607353.446344:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129990912 00000100:00100000:3.0:1789607353.446357:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129990912 00000100:00100000:3.0:1789607353.446459:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1789607353.446471:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:6454:x1876539129990912:12345-192.168.203.25@tcp:13: 00002000:00000024:3.0:1789607353.446509:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607353.446581:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:6454:x1876539129990912:12345-192.168.203.25@tcp:13: Request processed in 111us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607353.446587:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00080000:0.0:1789607353.448841:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607353.457523:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607353.457634:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991040 00000100:00100000:3.0:1789607353.457644:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991040 00000100:00100000:3.0:1789607353.457822:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1789607353.457832:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6454:x1876539129991040:12345-192.168.203.25@tcp:13: 00002000:00000024:3.0:1789607353.457884:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607353.457962:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:6454:x1876539129991040:12345-192.168.203.25@tcp:13: Request processed in 132us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607353.457986:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00080000:0.0:1789607353.474639:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789607353.572402:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607354.084260:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149964928:0@lo:13: 00000100:00100000:0.0:1789607354.084335:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607354.084393:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607354.084400:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149965056:0@lo:13: 00000100:00100000:0.0:1789607354.084423:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607354.084461:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149964928 00000100:00100000:0.0:1789607354.084468:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149964928 00000100:00100000:0.0:1789607354.084512:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965056 00000100:00100000:0.0:1789607354.084515:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965056 00000100:00100000:0.0:1789607354.084533:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607354.084542:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149964928:12345-0@lo:13: 00002000:00000024:0.0:1789607354.084565:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607354.084607:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149964928:12345-0@lo:13: Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607354.084614:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607354.084632:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607354.084638:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149965056:12345-0@lo:13: 00002000:00000024:0.0:1789607354.084647:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607354.084686:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149965056:12345-0@lo:13: Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607354.084692:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789607354.084711:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607354.084736:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901374e00 x1876539149965056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607354.084755:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149965056:0@lo:13: 00010000:00080000:0.0:1789607354.084767:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5bd1c00 x1876539149964928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607354.084778:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149964928:0@lo:13: 00000100:00100000:1.0:1789607354.600270:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149965184:0@lo:41: 00000100:00100000:1.0:1789607354.600395:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607354.602272:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965184 00000100:00100000:1.0:1789607354.602287:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965184 00000100:00100000:1.0:1789607354.602345:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607354.602356:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149965184:12345-0@lo:41: 00000004:00000024:1.0:1789607354.602399:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607354.602476:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149965184:12345-0@lo:41: Request processed in 123us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607354.602483:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607354.602533:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149965184:0@lo:41: 00010000:00010000:0.0:1789607354.608553:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607355.108071:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607355.108102:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149965312:0@lo:41: 00000100:00100000:2.0:1789607355.108159:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607355.108378:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965312 00000100:00100000:2.0:1789607355.108386:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965312 00000100:00100000:2.0:1789607355.108431:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607355.108439:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149965312:12345-0@lo:41: 00000004:00000024:2.0:1789607355.108474:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607355.108515:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149965312:12345-0@lo:41: Request processed in 76us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607355.108528:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607355.108808:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149965312:0@lo:41: 00000001:00100000:1.0:1789607355.204188:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00010000:00010000:0.0:1789607355.618231:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607355.910430:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607355.910473:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607355.910495:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607355.910512:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607355.910546:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607355.910573:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991296 00000100:00100000:3.0:1789607355.910584:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991296 00000100:00100000:3.0:1789607355.910638:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991424 00000100:00100000:3.0:1789607355.910641:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991424 00000100:00100000:3.0:1789607355.910666:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1789607355.910675:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129991296:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607355.910747:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129991296:12345-192.168.203.25@tcp:400: Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607355.910754:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1789607355.910771:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:3.0:1789607355.910778:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129991424:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607355.910802:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129991424:12345-192.168.203.25@tcp:400: Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607355.910808:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:3.0:1789607355.910826:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991552 00000100:00100000:3.0:1789607355.910829:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991552 00000100:00100000:3.0:1789607355.910854:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991680 00000100:00100000:3.0:1789607355.910857:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991680 00000100:00100000:3.0:1789607355.910928:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607355.910935:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129991552:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607355.910974:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129991552:12345-192.168.203.25@tcp:400: Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607355.910982:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607355.910994:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607355.911001:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129991680:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607355.911026:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129991680:12345-192.168.203.25@tcp:400: Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607355.911031:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00080000:3.0:1789607355.911051:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607355.911055:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607355.911058:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607355.911059:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607355.911288:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991168 00000100:00100000:1.0:1789607355.911292:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991168 00000100:00100000:1.0:1789607355.911322:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 198 00000100:00100000:1.0:1789607355.911329:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129991168:12345-192.168.203.25@tcp:400: 00000100:00100000:1.0:1789607355.911363:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129991168:12345-192.168.203.25@tcp:400: Request processed in 34us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607355.911369:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 198 00000001:02000400:0.0:1789607356.585495:0:9738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789607356.645971:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607357.155514:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149965440:0@lo:13: 00000100:00100000:1.0:1789607357.155605:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607357.155681:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965440 00000100:00100000:1.0:1789607357.155688:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965440 00000100:00100000:1.0:1789607357.155736:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607357.155745:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149965440:12345-0@lo:13: 00002000:00000024:1.0:1789607357.155787:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607357.156050:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149965440:12345-0@lo:13: Request processed in 305us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607357.156057:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789607357.156110:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78faae1500 x1876539149965440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607357.156128:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149965440:0@lo:13: 00000100:00080000:3.0:1789607357.159520:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607357.159542:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149965568:0@lo:13: 00000100:00100000:3.0:1789607357.159598:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607357.159743:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965568 00000100:00100000:3.0:1789607357.159751:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965568 00000100:00100000:3.0:1789607357.159793:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607357.159800:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149965568:12345-0@lo:13: 00002000:00000024:3.0:1789607357.159820:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607357.159855:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149965568:12345-0@lo:13: Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607357.159881:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789607357.159911:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607357.160239:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901376300 x1876539149965568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607357.160257:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149965568:0@lo:13: 00000100:00100000:1.0:1789607357.163340:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149965824:0@lo:400: 00000100:00100000:1.0:1789607357.163422:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607357.163469:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607357.163476:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149965696:0@lo:400: 00000100:00100000:1.0:1789607357.163503:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607357.163531:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149966208:0@lo:400: 00000100:00100000:1.0:1789607357.163556:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607357.163589:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966208 00000100:00100000:1.0:1789607357.163597:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966208 00000100:00100000:1.0:1789607357.163644:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789607357.163653:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149966208:12345-0@lo:400: 00000100:00100000:1.0:1789607357.163705:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149966208:12345-0@lo:400: Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607357.163711:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789607357.163750:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149966208:0@lo:400: 00000100:00100000:3.0:1789607357.166772:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965824 00000100:00100000:3.0:1789607357.166786:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965824 00000100:00100000:3.0:1789607357.166841:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789607357.166850:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149965824:12345-0@lo:400: 00000100:00100000:3.0:1789607357.167001:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149965824:12345-0@lo:400: Request processed in 152us (3580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607357.167009:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789607357.167035:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965696 00000100:00100000:3.0:1789607357.167040:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965696 00000100:00100000:3.0:1789607357.167064:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789607357.167070:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539149965696:12345-0@lo:400: 00000100:00100000:3.0:1789607357.167113:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539149965696:12345-0@lo:400: Request processed in 44us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607357.167118:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789607357.167383:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149966080:0@lo:400: 00000100:00100000:3.0:1789607357.167417:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607357.167451:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607357.167458:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149965952:0@lo:400: 00000100:00100000:3.0:1789607357.167479:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607357.167503:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966080 00000100:00100000:3.0:1789607357.167507:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966080 00000100:00100000:3.0:1789607357.167531:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607357.167537:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149966080:12345-0@lo:400: 00000100:00100000:3.0:1789607357.167568:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149966080:12345-0@lo:400: Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607357.167573:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607357.167591:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149965952 00000100:00100000:3.0:1789607357.167607:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149965952 00000100:00100000:3.0:1789607357.167632:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789607357.167638:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149965952:12345-0@lo:400: 00000100:00100000:3.0:1789607357.167668:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149965952:12345-0@lo:400: Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607357.167673:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789607357.167717:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149965696:0@lo:400: 00000100:00100000:3.0:1789607357.167731:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149965824:0@lo:400: 00000100:00100000:3.0:1789607357.167757:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149965952:0@lo:400: 00000100:00100000:3.0:1789607357.167766:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149966080:0@lo:400: 00000100:00100000:2.0:1789607357.169131:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149966720:0@lo:400: 00000100:00100000:1.0:1789607357.169161:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149966336:0@lo:400: 00000100:00100000:2.0:1789607357.169180:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607357.169188:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607357.169227:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149966848:0@lo:400: 00000100:00100000:1.0:1789607357.169247:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607357.169276:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966720 00000100:00100000:0.0:1789607357.169283:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966720 00000100:00100000:1.0:1789607357.169313:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966336 00000100:00100000:1.0:1789607357.169317:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966336 00000100:00100000:0.0:1789607357.169323:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607357.169332:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149966720:12345-0@lo:400: 00000100:00100000:1.0:1789607357.169341:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966848 00000100:00100000:1.0:1789607357.169343:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966848 00000100:00100000:1.0:1789607357.169363:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789607357.169368:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149966336:12345-0@lo:400: 00000100:00100000:0.0:1789607357.169391:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149966720:12345-0@lo:400: Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607357.169398:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607357.169399:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149966336:12345-0@lo:400: Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607357.169404:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789607357.169416:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607357.169421:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149966848:12345-0@lo:400: 00010000:00080000:0.0:1789607357.169428:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0702d80 x1876539149966720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607357.169440:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149966720:0@lo:400: 00000100:00100000:1.0:1789607357.169444:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149966848:12345-0@lo:400: Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607357.169449:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607357.169650:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149966336:0@lo:400: 00000100:00100000:1.0:1789607357.169660:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149966848:0@lo:400: 00000100:00080000:3.0:1789607357.169877:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607357.169882:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607357.169891:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149966464:0@lo:400: 00000100:00100000:3.0:1789607357.169932:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607357.169951:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149966976:0@lo:400: 00000100:00100000:3.0:1789607357.169969:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607357.170029:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607357.170036:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149966592:0@lo:400: 00000100:00100000:3.0:1789607357.170056:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607357.170117:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966464 00000100:00100000:0.0:1789607357.170122:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966464 00000100:00100000:0.0:1789607357.170180:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966976 00000100:00100000:0.0:1789607357.170184:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966976 00000100:00100000:2.0:1789607357.170187:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149966592 00000100:00100000:2.0:1789607357.170191:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149966592 00000100:00080000:3.0:1789607357.170211:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607357.170214:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607357.170290:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789607357.170297:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149966464:12345-0@lo:400: 00000100:00100000:0.0:1789607357.170336:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149966464:12345-0@lo:400: Request processed in 40us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607357.170343:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789607357.170351:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149966976:12345-0@lo:400: 00000100:00100000:0.0:1789607357.170354:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789607357.170382:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149966976:12345-0@lo:400: Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607357.170388:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1789607357.170468:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700000 x1876539149966464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607357.170479:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149966464:0@lo:400: 00010000:00080000:3.0:1789607357.170488:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700380 x1876539149966976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607357.170503:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149966976:0@lo:400: 00000100:00100000:2.0:1789607357.175489:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607357.175503:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149966592:12345-0@lo:400: 00000100:00100000:2.0:1789607357.175592:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149966592:12345-0@lo:400: Request processed in 92us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607357.175599:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789607357.176915:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703800 x1876539149966592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607357.176938:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149966592:0@lo:400: 00010000:00010000:2.0:1789607357.666155:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607358.691178:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607359.205179:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149967104:0@lo:13: 00000100:00100000:2.0:1789607359.205399:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607359.205547:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149967104 00000100:00100000:1.0:1789607359.205554:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149967104 00000100:00080000:3.0:1789607359.205586:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607359.205597:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149967232:0@lo:13: 00000100:00100000:1.0:1789607359.205604:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607359.205612:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149967104:12345-0@lo:13: 00002000:00000024:1.0:1789607359.205645:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607359.205688:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607359.205718:0:8115:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789607359.205719:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149967104:12345-0@lo:13: Request processed in 108us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607359.205724:0:8115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789607359.205725:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607359.205746:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149967232 00000100:00100000:1.0:1789607359.205749:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149967232 00000100:00100000:1.0:1789607359.205774:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607359.205780:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149967232:12345-0@lo:13: 00002000:00000024:1.0:1789607359.205789:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789607359.205797:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607359.205818:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149967232:12345-0@lo:13: Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607359.205823:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789607359.205854:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78faae2d80 x1876539149967104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607359.205908:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149967104:0@lo:13: 00010000:00080000:1.0:1789607359.205944:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901377100 x1876539149967232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607359.205969:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149967232:0@lo:13: 00000100:00100000:2.0:1789607359.716541:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607359.716568:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149967360:0@lo:41: 00000100:00100000:2.0:1789607359.716637:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607359.716985:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607359.717454:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149967360 00000100:00100000:1.0:1789607359.717463:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149967360 00000100:00100000:1.0:1789607359.717521:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789607359.717531:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149967360:12345-0@lo:41: 00000004:00000024:1.0:1789607359.717572:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607359.717646:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149967360:12345-0@lo:41: Request processed in 117us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607359.717653:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789607359.717722:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149967360:0@lo:41: 00000100:00100000:2.0:1789607360.227900:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607360.227926:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149967488:0@lo:41: 00000100:00100000:2.0:1789607360.228000:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607360.228169:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149967488 00000100:00100000:0.0:1789607360.228178:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149967488 00000100:00100000:0.0:1789607360.228229:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607360.228240:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149967488:12345-0@lo:41: 00000004:00000024:0.0:1789607360.228282:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607360.228352:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149967488:12345-0@lo:41: Request processed in 115us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607360.228360:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607360.228412:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149967488:0@lo:41: 00010000:00010000:1.0:1789607360.738093:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607360.826217:0:9887:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe81a0bdf0 20000000:00000080:2.0:1789607360.826233:0:9887:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d79011ae800 uarg=0000000000000000 20000000:01000000:2.0:1789607360.826267:0:9887:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789607360.826269:0:9887:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789607360.826272:0:9887:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789607360.826276:0:9887:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789607360.826287:0:9887:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789607360.826301:0:9887:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789607360.826304:0:9887:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789607360.826747:0:9887:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789607360.826751:0:9887:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607360.827741:0:9888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789607360.828284:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789607360.828351:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789607360.828390:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1789607360.828402:0:9887:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789607360.828405:0:9887:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607360.830521:0:9889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789607360.831400:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789607360.831443:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789607360.831499:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1789607360.831513:0:9887:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789607360.831515:0:9887:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607360.832269:0:9890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789607360.832680:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789607360.832723:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789607360.832772:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789607360.832784:0:9887:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789607360.832786:0:9887:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607360.834437:0:9891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789607360.835408:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789607360.835459:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789607360.835625:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789607360.835642:0:9887:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789607360.835645:0:9887:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607360.836466:0:9892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789607360.837075:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789607360.837139:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789607360.837179:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:3.0:1789607360.837196:0:9887:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789607360.837215:0:9887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837233:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837241:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837248:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd50e expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837262:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd51c expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837268:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd52a expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837274:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd546 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837280:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd570 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837286:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd58c expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837293:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837302:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 9 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837309:0:9887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837317:0:9887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837355:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837383:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 9 pid: 6464 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.837400:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149967616:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607360.837553:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 9 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837562:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 9 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.837571:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149967744:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607360.837602:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837610:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 23 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.837618:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901376d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149967872:0@lo:104: 00000100:00100000:3.0:1789607360.837655:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607360.837709:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd58c expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837718:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd58c expref: 23 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.837728:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968000:0@lo:104: 00000100:00100000:3.0:1789607360.837751:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607360.837833:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd570 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.837842:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd570 expref: 23 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.837850:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968128:0@lo:104: 00000100:00100000:3.0:1789607360.837901:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607360.838255:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd546 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.838265:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd546 expref: 23 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.838274:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968256:0@lo:104: 00000100:00100000:3.0:1789607360.838300:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.838381:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149967872 00000100:00100000:1.0:1789607360.838389:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149967872 00000100:00100000:1.0:1789607360.838426:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968000 00000100:00100000:1.0:1789607360.838429:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968000 00000100:00100000:1.0:1789607360.838440:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968128 00000100:00100000:1.0:1789607360.838442:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968128 00000100:00100000:1.0:1789607360.838455:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607360.838463:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+5:9887:x1876539149967872:12345-0@lo:104: 00010000:00010000:1.0:1789607360.838475:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838528:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607360.838534:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+5:9887:x1876539149967872:12345-0@lo:104: Request processed in 73us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.838541:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607360.838560:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607360.838566:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+4:9887:x1876539149968000:12345-0@lo:104: 00010000:00010000:1.0:1789607360.838573:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838605:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607360.838611:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+4:9887:x1876539149968000:12345-0@lo:104: Request processed in 46us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.838616:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607360.838638:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607360.838644:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+3:9887:x1876539149968128:12345-0@lo:104: 00010000:00010000:1.0:1789607360.838652:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838687:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789607360.838692:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+3:9887:x1876539149968128:12345-0@lo:104: Request processed in 49us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.838697:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789607360.838713:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607360.838718:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838725:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.838730:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838739:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.838746:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.838752:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.838780:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838787:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.838817:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838834:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbd5b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd5bd expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838846:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607360.838850:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838855:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.838858:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838897:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.838904:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.838910:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.838925:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838930:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.838945:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838951:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571f400/0xa26202d240fbd58c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd593 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838959:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607360.838969:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838974:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031c00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.838977:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.838983:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.838988:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.838993:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.839006:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839011:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.839017:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839022:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c0031c00/0xa26202d240fbd570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd577 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839032:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607360.839034:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607360.839036:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607360.839044:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607360.839055:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149968384:0@lo:103: 00000100:00100000:1.0:1789607360.839087:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.839120:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149968640:0@lo:103: 00000100:00100000:1.0:1789607360.839149:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.839169:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607360.839174:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149968512:0@lo:103: 00000100:00100000:1.0:1789607360.839193:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.839215:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968384 00000100:00100000:1.0:1789607360.839220:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968384 00010000:00010000:1.0:1789607360.839238:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 24 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.839257:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968640 00000100:00100000:1.0:1789607360.839259:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968640 00010000:00010000:1.0:1789607360.839270:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd570 expref: 25 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.839279:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968512 00000100:00100000:1.0:1789607360.839281:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968512 00010000:00010000:1.0:1789607360.839289:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd58c expref: 26 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.839299:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607360.839304:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f06af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+26:3470:x1876539149968384:12345-0@lo:103: 00010000:00010000:1.0:1789607360.839313:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.839317:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 26 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839325:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 26 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839340:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.839368:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f06af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+26:3470:x1876539149968384:12345-0@lo:103: Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.839381:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607360.839422:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607360.839428:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+25:3469:x1876539149968640:12345-0@lo:103: 00010000:00010000:1.0:1789607360.839435:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.839439:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd570 expref: 25 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839446:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd570 expref: 25 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839456:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.839482:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+25:3469:x1876539149968640:12345-0@lo:103: Request processed in 55us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.839488:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607360.839499:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607360.839505:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539149968512:12345-0@lo:103: 00010000:00010000:1.0:1789607360.839511:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.839516:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd58c expref: 24 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839524:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd58c expref: 24 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.839533:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.839554:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539149968512:12345-0@lo:103: Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.839560:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607360.839601:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149968384:0@lo:103: 00000100:00100000:1.0:1789607360.839635:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149968512:0@lo:103: 00000100:00100000:1.0:1789607360.839642:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149968640:0@lo:103: 00010000:00010000:1.0:1789607360.841311:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607360.841321:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607360.842119:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd52a expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.842135:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd52a expref: 23 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842149:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968768:0@lo:104: 00010000:00010000:3.0:1789607360.842199:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd51c expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.842208:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd51c expref: 23 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842216:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968896:0@lo:104: 00010000:00010000:3.0:1789607360.842258:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd50e expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.842268:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd50e expref: 23 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842276:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149969024:0@lo:104: 00010000:00010000:3.0:1789607360.842298:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.842305:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 23 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842313:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149969152:0@lo:104: 00010000:00010000:3.0:1789607360.842337:0:9887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607360.842345:0:9887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 23 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842353:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149969280:0@lo:104: 00000100:00100000:3.0:1789607360.842372:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9780 going to sleep for 11 seconds 00010000:00010000:3.0:1789607360.842396:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e800/0xa26202d240fbd5bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd5b6 expref: 23 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842409:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901376d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149967872:0@lo:104: 00010000:00010000:3.0:1789607360.842420:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd58c expref: 22 pid: 6463 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842428:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968000:0@lo:104: 00010000:00010000:3.0:1789607360.842447:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd570 expref: 21 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.842458:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968128:0@lo:104: 00000100:00100000:1.0:1789607360.842564:0:9064:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789607360.842588:0:9064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.842601:0:9064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.842609:0:9064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.842617:0:9064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.842625:0:9064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.842633:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968256 00000100:00100000:1.0:1789607360.842640:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968256 00000100:00100000:1.0:1789607360.842675:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968768 00000100:00100000:1.0:1789607360.842678:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968768 00000100:00100000:1.0:1789607360.842689:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149968896 00000100:00100000:1.0:1789607360.842691:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149968896 00000100:00100000:1.0:1789607360.842700:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969024 00000100:00100000:1.0:1789607360.842703:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969024 00000100:00100000:1.0:1789607360.842712:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969152 00000100:00100000:1.0:1789607360.842714:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969152 00000100:00100000:1.0:1789607360.842723:0:9064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969280 00000100:00100000:1.0:1789607360.842725:0:9064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969280 00000100:00100000:1.0:1789607360.842737:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607360.842744:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfcc6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+8:9887:x1876539149968256:12345-0@lo:104: 00010000:00010000:1.0:1789607360.842756:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.842817:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607360.842823:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfcc6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+8:9887:x1876539149968256:12345-0@lo:104: Request processed in 79us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.842837:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607360.842907:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607360.842914:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+7:9887:x1876539149968768:12345-0@lo:104: 00010000:00010000:1.0:1789607360.842923:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.842960:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607360.842965:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+7:9887:x1876539149968768:12345-0@lo:104: Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.842970:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607360.842984:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607360.842989:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+6:9887:x1876539149968896:12345-0@lo:104: 00010000:00010000:1.0:1789607360.842995:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843024:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789607360.843029:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+6:9887:x1876539149968896:12345-0@lo:104: Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.843033:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607360.843045:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607360.843050:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+5:9887:x1876539149969024:12345-0@lo:104: 00010000:00010000:1.0:1789607360.843057:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843084:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789607360.843089:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+5:9887:x1876539149969024:12345-0@lo:104: Request processed in 39us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.843100:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607360.843113:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607360.843119:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+4:9887:x1876539149969152:12345-0@lo:104: 00010000:00010000:1.0:1789607360.843126:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843153:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789607360.843158:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+4:9887:x1876539149969152:12345-0@lo:104: Request processed in 40us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.843163:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607360.843176:0:9064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607360.843181:0:9064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+3:9887:x1876539149969280:12345-0@lo:104: 00010000:00010000:1.0:1789607360.843188:0:9064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843212:0:9064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789607360.843216:0:9064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c0415db0-4674-4bfe-9696-a490439e72d4+3:9887:x1876539149969280:12345-0@lo:104: Request processed in 36us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.843221:0:9064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789607360.843238:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789607360.843243:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843250:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.843254:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843271:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.843277:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.843282:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.843309:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843315:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.843327:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843333:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c0031200/0xa26202d240fbd546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd54d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843345:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789607360.843348:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843353:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.843356:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843363:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.843369:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.843380:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.843396:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843402:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.843407:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843413:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbd52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd531 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843423:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789607360.843426:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843431:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.843435:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843441:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.843447:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.843452:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.843462:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843468:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.843484:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843491:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075c800/0xa26202d240fbd51c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd523 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843500:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607360.843503:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843507:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.843510:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843516:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.843521:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.843526:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.843538:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843543:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.843548:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843554:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd50e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd515 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843564:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607360.843573:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843579:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.843581:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843587:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.843592:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.843597:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.843610:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843615:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.843619:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843624:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd4cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4d6 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843632:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607360.843634:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843640:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79021db600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607360.843642:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843657:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607360.843662:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607360.843667:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607360.843678:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843683:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607360.843687:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843693:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d79021db600/0xa26202d240fbd4a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4ac expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.843706:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607360.843707:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607360.843709:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607360.843724:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607360.843735:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149969408:0@lo:103: 00000100:00100000:1.0:1789607360.843767:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.843797:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149969920:0@lo:103: 00000100:00100000:1.0:1789607360.843815:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.843833:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789607360.843839:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149969536:0@lo:103: 00000100:00100000:1.0:1789607360.843857:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.843922:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149970048:0@lo:103: 00000100:00100000:1.0:1789607360.843953:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.843982:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969408 00000100:00100000:1.0:1789607360.843988:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969408 00010000:00010000:1.0:1789607360.844008:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd546 expref: 21 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.844024:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969920 00000100:00100000:1.0:1789607360.844026:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969920 00010000:00010000:1.0:1789607360.844036:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 22 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.844045:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969536 00000100:00100000:1.0:1789607360.844047:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969536 00010000:00010000:1.0:1789607360.844055:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd52a expref: 23 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.844064:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970048 00000100:00100000:1.0:1789607360.844066:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970048 00010000:00010000:1.0:1789607360.844073:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 24 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.844084:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607360.844089:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149969408:12345-0@lo:103: 00010000:00010000:1.0:1789607360.844098:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.844103:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd546 expref: 24 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844111:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd546 expref: 24 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844136:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.844167:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149969408:12345-0@lo:103: Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.844173:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607360.844186:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607360.844192:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+23:3470:x1876539149969920:12345-0@lo:103: 00010000:00010000:1.0:1789607360.844200:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.844204:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 23 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844211:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 23 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844220:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.844240:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+23:3470:x1876539149969920:12345-0@lo:103: Request processed in 49us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.844247:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607360.844258:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607360.844264:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+22:3470:x1876539149969536:12345-0@lo:103: 00010000:00010000:1.0:1789607360.844271:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.844275:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd52a expref: 22 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844283:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd52a expref: 22 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844291:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.844317:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+22:3470:x1876539149969536:12345-0@lo:103: Request processed in 54us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.844322:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607360.844334:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607360.844340:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+21:3470:x1876539149970048:12345-0@lo:103: 00010000:00010000:1.0:1789607360.844346:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.844350:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 21 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844358:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 21 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844367:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.844387:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+21:3470:x1876539149970048:12345-0@lo:103: Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.844392:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607360.844418:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149969792:0@lo:103: 00000100:00100000:1.0:1789607360.844443:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.844461:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607360.844466:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149969664:0@lo:103: 00000100:00100000:1.0:1789607360.844502:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607360.844528:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969792 00000100:00100000:1.0:1789607360.844532:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969792 00010000:00010000:1.0:1789607360.844547:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd50e expref: 21 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.844564:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149969664 00000100:00100000:1.0:1789607360.844566:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149969664 00010000:00010000:1.0:1789607360.844576:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd51c expref: 22 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607360.844593:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607360.844598:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f06ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+22:3469:x1876539149969792:12345-0@lo:103: 00010000:00010000:1.0:1789607360.844605:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.844608:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd50e expref: 22 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844616:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd50e expref: 22 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844625:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.844653:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f06ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+22:3469:x1876539149969792:12345-0@lo:103: Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.844659:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607360.844688:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607360.844693:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+21:3469:x1876539149969664:12345-0@lo:103: 00010000:00010000:1.0:1789607360.844699:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607360.844703:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd51c expref: 21 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844709:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd51c expref: 21 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607360.844717:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607360.844735:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0415db0-4674-4bfe-9696-a490439e72d4+21:3469:x1876539149969664:12345-0@lo:103: Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607360.844740:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607360.844769:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149969664:0@lo:103: 00000100:00100000:1.0:1789607360.844785:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149969792:0@lo:103: 00010000:00010000:1.0:1789607360.844804:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607360.844815:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149969536:0@lo:103: 00000100:00100000:1.0:1789607360.844822:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149970048:0@lo:103: 00000100:00100000:1.0:1789607360.844828:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149969408:0@lo:103: 00000100:00100000:1.0:1789607360.844834:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149969920:0@lo:103: 00010000:00010000:3.0:1789607360.845462:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd54d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd546 expref: 20 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.845476:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968256:0@lo:104: 00010000:00010000:3.0:1789607360.845486:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021da400/0xa26202d240fbd531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd52a expref: 19 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.845496:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968768:0@lo:104: 00010000:00010000:3.0:1789607360.845504:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021dba00/0xa26202d240fbd523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd51c expref: 18 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.845513:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149968896:0@lo:104: 00010000:00010000:3.0:1789607360.845520:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021db000/0xa26202d240fbd515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd50e expref: 17 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.845527:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149969024:0@lo:104: 00010000:00010000:3.0:1789607360.845536:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021da600/0xa26202d240fbd4d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd4cf expref: 16 pid: 6464 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.845543:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149969152:0@lo:104: 00010000:00010000:3.0:1789607360.845551:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd4ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd4a5 expref: 15 pid: 6462 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607360.845558:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149969280:0@lo:104: 00000100:00100000:3.0:1789607360.856988:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607360.857065:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607360.857096:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991808 00000100:00100000:0.0:1789607360.857104:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991808 00010000:00010000:0.0:1789607360.857141:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 10 pid: 6464 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607360.857182:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129991936 00000100:00100000:0.0:1789607360.857186:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129991936 00010000:00010000:0.0:1789607360.857209:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 11 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607360.857231:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1789607360.857256:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:2396:x1876539129991808:12345-192.168.203.25@tcp:103: 00010000:00010000:0.0:1789607360.857272:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607360.857278:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 11 pid: 6464 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857289:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 11 pid: 6464 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607360.857294:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149967616:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607360.857303:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9887:1876539149967744:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607360.857306:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e400/0xa26202d240fbd5d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66875e expref: 11 pid: 6464 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857318:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607360.857346:0:9887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607360.857359:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129991808:12345-192.168.203.25@tcp:103: Request processed in 106us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607360.857365:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1789607360.857382:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:0.0:1789607360.857388:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:2396:x1876539129991936:12345-192.168.203.25@tcp:103: 00010000:00010000:0.0:1789607360.857396:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607360.857399:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 9 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857408:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 9 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857418:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd5cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668757 expref: 9 pid: 6463 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857428:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857442:0:7268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857457:0:7268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857464:0:7268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857470:0:7268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857478:0:7268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857483:0:7268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607360.857486:0:7268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857493:0:7268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857513:0:7268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607360.857523:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607360.857541:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:2396:x1876539129991936:12345-192.168.203.25@tcp:103: Request processed in 153us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607360.857561:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00010000:00010000:2.0:1789607360.857697:0:9887:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607360.857704:0:9887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607360.857710:0:9887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbd611 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607361.035541:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607361.035610:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992064 00000100:00100000:0.0:1789607361.035628:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992064 00000100:00100000:0.0:1789607361.035702:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:0.0:1789607361.035712:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539129992064:12345-192.168.203.25@tcp:400: 00000100:00100000:0.0:1789607361.035783:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539129992064:12345-192.168.203.25@tcp:400: Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607361.035789:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00080000:3.0:1789607361.036123:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607361.038001:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607361.038047:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607361.038079:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607361.038111:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992320 00000100:00100000:3.0:1789607361.038119:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992320 00000100:00100000:3.0:1789607361.038169:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992448 00000100:00100000:3.0:1789607361.038173:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992448 00000100:00100000:3.0:1789607361.038198:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:3.0:1789607361.038206:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129992320:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607361.038269:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129992320:12345-192.168.203.25@tcp:400: Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607361.038276:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:3.0:1789607361.038294:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1789607361.038301:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129992448:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1789607361.038326:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129992448:12345-192.168.203.25@tcp:400: Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607361.038331:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00080000:3.0:1789607361.038357:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607361.038361:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607361.038568:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992192 00000100:00100000:0.0:1789607361.038574:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992192 00000100:00100000:0.0:1789607361.038620:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:0.0:1789607361.038628:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129992192:12345-192.168.203.25@tcp:400: 00000100:00100000:0.0:1789607361.038661:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129992192:12345-192.168.203.25@tcp:400: Request processed in 35us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607361.038668:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00080000:3.0:1789607361.039449:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789607361.762211:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607362.210666:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789607362.210674:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78f77e7800 from 48 10000000:01000000:1.0:1789607362.210679:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607362.210727:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.210739:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.210750:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.210788:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970176:0@lo:101: 00000100:00100000:1.0:1789607362.210987:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.211050:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.211322:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970176 00000100:00100000:0.0:1789607362.211332:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970176 00000100:00100000:0.0:1789607362.211429:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789607362.211439:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+15:6466:x1876539149970176:12345-0@lo:101: 00010000:00010000:0.0:1789607362.211452:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607362.211467:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbd61f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd618 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.211499:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbd61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd618 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.211511:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbd61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd618 expref: 16 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.211519:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075ca00, rc 0) 00000100:00100000:0.0:1789607362.211592:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149970176:12345-0@lo:101: Request processed in 154us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.211599:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789607362.211637:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970176:0@lo:101: 00010000:00010000:1.0:1789607362.211655:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.211676:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.211728:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970304:0@lo:501: 00000100:00100000:1.0:1789607362.211755:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.212819:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.212820:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970304 00000100:00100000:3.0:1789607362.212831:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970304 00000100:00100000:3.0:1789607362.212894:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789607362.212903:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149970304:12345-0@lo:501: 00000100:00100000:3.0:1789607362.213550:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149970304:12345-0@lo:501: Request processed in 647us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.213557:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789607362.213997:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970304:0@lo:501: 00000100:00100000:1.0:1789607362.214042:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970432:0@lo:503: 00000100:00100000:1.0:1789607362.214091:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.214126:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.214173:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970432 00000100:00100000:3.0:1789607362.214179:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970432 00000100:00100000:3.0:1789607362.214248:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789607362.214256:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149970432:12345-0@lo:503: 00000100:00100000:3.0:1789607362.215899:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149970432:12345-0@lo:503: Request processed in 1638us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.215910:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789607362.216044:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970432:0@lo:503: 00000100:00100000:3.0:1789607362.221002:0:9904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9904:1876539149970560:0@lo:502: 00000100:00100000:3.0:1789607362.221088:0:9904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.221213:0:9904:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.223684:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970560 00000100:00100000:2.0:1789607362.223697:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970560 00000100:00100000:2.0:1789607362.223834:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789607362.223845:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9904:x1876539149970560:12345-0@lo:502: 00000100:00100000:2.0:1789607362.224433:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:9904:x1876539149970560:12345-0@lo:502: Request processed in 589us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.224441:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789607362.224495:0:9904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9904:1876539149970560:0@lo:502: 00000100:00100000:3.0:1789607362.224557:0:9904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9904:1876539149970688:0@lo:502: 00000100:00100000:3.0:1789607362.224613:0:9904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.224658:0:9904:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.224984:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970688 00000100:00100000:0.0:1789607362.224990:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970688 00000100:00100000:0.0:1789607362.225032:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789607362.225040:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:9904:x1876539149970688:12345-0@lo:502: 00000100:00100000:0.0:1789607362.225360:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+16:9904:x1876539149970688:12345-0@lo:502: Request processed in 320us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.225369:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789607362.228095:0:9904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9904:1876539149970688:0@lo:502: 00000040:00080000:3.0:1789607362.228145:0:9904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789607362.228911:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789607362.228933:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607362.228944:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.228955:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607362.228965:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789607362.228967:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789607362.228971:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789607362.229006:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.229015:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.229037:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.229057:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970816:0@lo:101: 00000100:00100000:1.0:1789607362.229116:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.229163:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.229323:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970816 00000100:00100000:2.0:1789607362.229330:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970816 00000100:00100000:2.0:1789607362.229440:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789607362.229450:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+16:6466:x1876539149970816:12345-0@lo:101: 00010000:00010000:2.0:1789607362.229462:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607362.229474:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbd62d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd626 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.229498:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbd62d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd626 expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.229508:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbd62d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd626 expref: 17 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.229516:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59dc00, rc 0) 00000100:00100000:2.0:1789607362.229561:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149970816:12345-0@lo:101: Request processed in 112us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.229567:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789607362.230076:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970816:0@lo:101: 00010000:00010000:1.0:1789607362.230092:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.230101:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.230150:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970944:0@lo:501: 00000100:00100000:1.0:1789607362.230182:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.230253:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.232574:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149970944 00000100:00100000:0.0:1789607362.232590:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149970944 00000100:00100000:0.0:1789607362.232652:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789607362.232662:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149970944:12345-0@lo:501: 00000100:00100000:0.0:1789607362.232995:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149970944:12345-0@lo:501: Request processed in 335us (2811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.233002:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789607362.233223:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149970944:0@lo:501: 00000100:00100000:1.0:1789607362.233269:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971072:0@lo:503: 00000100:00100000:1.0:1789607362.233313:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.233367:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.233566:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971072 00000100:00100000:2.0:1789607362.233577:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971072 00000100:00100000:2.0:1789607362.233652:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789607362.233659:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149971072:12345-0@lo:503: 00000100:00100000:2.0:1789607362.234829:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149971072:12345-0@lo:503: Request processed in 1166us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.234838:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789607362.234933:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971072:0@lo:503: 00000100:00100000:3.0:1789607362.235138:0:9905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9905:1876539149971200:0@lo:502: 00000100:00100000:3.0:1789607362.235183:0:9905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.242628:0:9905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.243000:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971200 00000100:00100000:2.0:1789607362.243010:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971200 00000100:00100000:2.0:1789607362.243062:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789607362.243072:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9905:x1876539149971200:12345-0@lo:502: 00000100:00100000:2.0:1789607362.243331:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+17:9905:x1876539149971200:12345-0@lo:502: Request processed in 260us (8148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.243340:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789607362.243435:0:9905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9905:1876539149971200:0@lo:502: 00000020:01000000:3.0:1789607362.243477:0:9905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607362.243486:0:9905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607362.243489:0:9905:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789607362.243494:0:9905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789607362.243529:0:9905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9905:1876539149971328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.243565:0:9905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.243594:0:9905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.243633:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971328 00000100:00100000:0.0:1789607362.243639:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971328 00000100:00100000:0.0:1789607362.243681:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789607362.243690:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:9905:x1876539149971328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607362.243828:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+17:9905:x1876539149971328:12345-0@lo:502:llog_process_th.0 Request processed in 141us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.243836:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789607362.243891:0:9905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9905:1876539149971328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607362.243917:0:9905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607362.243921:0:9905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607362.243923:0:9905:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789607362.243926:0:9905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789607362.244138:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789607362.244156:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789607362.244165:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.244183:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607362.244192:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789607362.244194:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7901022000 from 48 10000000:01000000:0.0:1789607362.244197:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607362.244219:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.244227:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.244236:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607362.244250:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.244276:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607362.244294:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0625f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607362.245465:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971456 00000100:00100000:1.0:1789607362.245475:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971456 00000100:00100000:1.0:1789607362.245531:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789607362.245540:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+17:6466:x1876539149971456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607362.245554:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607362.245576:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902052200/0xa26202d240fbd63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd634 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.245599:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902052200/0xa26202d240fbd63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd634 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.245610:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902052200/0xa26202d240fbd63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd634 expref: 18 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.245619:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902052200, rc 0) 00000100:00100000:1.0:1789607362.245694:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149971456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.245702:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789607362.245721:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607362.245741:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607362.245751:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607362.245811:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.245840:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.245915:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607362.245958:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971584 00000100:00100000:1.0:1789607362.245964:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971584 00000100:00100000:1.0:1789607362.245982:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789607362.245988:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149971584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.249303:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149971584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3305us (3453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.249315:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789607362.250169:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.250225:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.250287:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.250380:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.258234:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971712 00000100:00100000:2.0:1789607362.258247:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971712 00000100:00100000:2.0:1789607362.258370:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789607362.258382:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149971712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.258621:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149971712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (8333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.258628:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789607362.258722:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149971712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.260446:0:9906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9906:1876539149971840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.260505:0:9906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.261374:0:9906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.261492:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971840 00000100:00100000:0.0:1789607362.261500:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971840 00000100:00100000:0.0:1789607362.261547:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789607362.261555:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:9906:x1876539149971840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607362.263181:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:9906:x1876539149971840:12345-0@lo:502:llog_process_th.0 Request processed in 1620us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.263192:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789607362.263228:0:9906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9906:1876539149971840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.263296:0:9906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9906:1876539149971968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.263500:0:9906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.263542:0:9906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.263775:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149971968 00000100:00100000:2.0:1789607362.263781:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149971968 00000100:00100000:2.0:1789607362.263820:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789607362.263829:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:9906:x1876539149971968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.264114:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+18:9906:x1876539149971968:12345-0@lo:502:llog_process_th.0 Request processed in 285us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.264121:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789607362.264266:0:9906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9906:1876539149971968:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789607362.264291:0:9906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789607362.264489:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789607362.264518:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607362.264529:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.264541:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607362.264550:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789607362.264558:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789607362.264561:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789607362.264586:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.264594:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.264603:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.264619:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149972096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.264649:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.265148:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.265203:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972096 00000100:00100000:0.0:1789607362.265210:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972096 00000100:00100000:0.0:1789607362.265250:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789607362.265265:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+18:6466:x1876539149972096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607362.265276:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607362.265288:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075de00/0xa26202d240fbd649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd642 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.265312:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075de00/0xa26202d240fbd649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd642 expref: 19 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.265322:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075de00/0xa26202d240fbd649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd642 expref: 19 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.265329:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075de00, rc 0) 00000100:00100000:0.0:1789607362.265614:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149972096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 350us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.265621:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789607362.266122:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149972096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607362.266139:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.266149:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.266208:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149972224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.266238:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.266304:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.266807:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972224 00000100:00100000:0.0:1789607362.266814:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972224 00000100:00100000:0.0:1789607362.266977:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789607362.266986:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149972224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.267248:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149972224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.267255:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789607362.267341:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149972224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.267383:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149972352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.267424:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.268172:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.268221:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972352 00000100:00100000:2.0:1789607362.268227:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972352 00000100:00100000:2.0:1789607362.268257:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789607362.268265:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149972352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.268455:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149972352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.268462:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789607362.268776:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149972352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.270493:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9907:1876539149972480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.270630:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.270791:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.271000:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972480 00000100:00100000:2.0:1789607362.271007:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972480 00000100:00100000:3.0:1789607362.271240:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789607362.271251:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+19:9907:x1876539149972480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.271939:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+19:9907:x1876539149972480:12345-0@lo:502:llog_process_th.0 Request processed in 689us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.271947:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789607362.272210:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9907:1876539149972480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607362.272241:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607362.272250:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607362.272252:0:9907:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789607362.272258:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789607362.272288:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9907:1876539149972608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.272336:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276160:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149972864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276231:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276269:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149973376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276293:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276312:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149973888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276331:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276364:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789607362.276370:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149972736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276390:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276407:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149973248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276425:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276441:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149973760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276459:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276479:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149972992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276499:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276510:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149973504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276544:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276562:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149974016:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276583:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276601:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789607362.276607:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149973120:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.276627:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.276643:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149973632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.278215:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.278251:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149974144:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.278273:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.278321:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972864 00000100:00100000:1.0:1789607362.278328:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972864 00000100:00100000:1.0:1789607362.278379:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973120 00000100:00100000:1.0:1789607362.278383:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973120 00000100:00100000:1.0:1789607362.278399:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789607362.278406:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149972864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.278462:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149972864:12345-0@lo:400:kworker.0 Request processed in 55us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.278468:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789607362.278486:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607362.278492:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149973120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.278535:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149973120:12345-0@lo:400:kworker.0 Request processed in 44us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.278541:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607362.278559:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973376 00000100:00100000:1.0:1789607362.278562:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973376 00000100:00100000:1.0:1789607362.278597:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973888 00000100:00100000:1.0:1789607362.278600:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973888 00000100:00100000:1.0:1789607362.278614:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972736 00000100:00100000:1.0:1789607362.278616:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972736 00000100:00100000:1.0:1789607362.278626:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973248 00000100:00100000:1.0:1789607362.278628:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973248 00000100:00100000:1.0:1789607362.278639:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973760 00000100:00100000:1.0:1789607362.278641:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973760 00000100:00100000:1.0:1789607362.279130:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972992 00000100:00100000:1.0:1789607362.279135:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972992 00000100:00100000:1.0:1789607362.279165:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789607362.279171:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149973376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279210:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149973376:12345-0@lo:400:kworker.0 Request processed in 40us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279215:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789607362.279229:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607362.279234:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149973888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279260:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149973888:12345-0@lo:400:kworker.0 Request processed in 26us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279266:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607362.279276:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789607362.279282:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149972736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279310:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149972736:12345-0@lo:400:kworker.0 Request processed in 29us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279315:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789607362.279327:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607362.279332:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149973248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279423:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149973248:12345-0@lo:400:kworker.0 Request processed in 90us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279429:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607362.279440:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607362.279447:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149973760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279474:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149973760:12345-0@lo:400:kworker.0 Request processed in 29us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279479:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607362.279497:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789607362.279503:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149972992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279723:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149972992:12345-0@lo:400:kworker.0 Request processed in 149us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279730:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789607362.279768:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973504 00000100:00100000:1.0:1789607362.279773:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973504 00000100:00100000:1.0:1789607362.279792:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974016 00000100:00100000:1.0:1789607362.279795:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974016 00000100:00100000:1.0:1789607362.279806:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149973632 00000100:00100000:1.0:1789607362.279809:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149973632 00000100:00100000:1.0:1789607362.279819:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974144 00000100:00100000:1.0:1789607362.279822:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974144 00000100:00100000:1.0:1789607362.279833:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607362.279838:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149973504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279912:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149973504:12345-0@lo:400:kworker.0 Request processed in 74us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279918:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607362.279929:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607362.279936:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149974016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.279965:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149974016:12345-0@lo:400:kworker.0 Request processed in 30us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.279970:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607362.279980:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607362.279985:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149973632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.280010:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149973632:12345-0@lo:400:kworker.0 Request processed in 26us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.280540:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607362.281129:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607362.281150:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607362.281160:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149974144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.281212:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149974144:12345-0@lo:400:kworker.0 Request processed in 56us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607362.281216:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607362.281308:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149972736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.281321:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149973248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.281332:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149973760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.281343:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149972864:0@lo:400:kworker.0 00010000:00080000:1.0:1789607362.281727:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0e680 x1876539149973376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607362.281742:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149973376:0@lo:400:kworker.0 00010000:00080000:1.0:1789607362.281760:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0d500 x1876539149973888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607362.281767:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149973888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.281791:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607362.281800:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149974272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607362.281841:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.282040:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149973120:0@lo:400:kworker.0 00010000:00080000:1.0:1789607362.282055:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0f480 x1876539149973632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607362.282073:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149973632:0@lo:400:kworker.0 00010000:00080000:1.0:1789607362.282088:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0df80 x1876539149974144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607362.282094:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149974144:0@lo:400:kworker.0 00000100:00100000:1.0:1789607362.282106:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149972992:0@lo:400:kworker.0 00010000:00080000:1.0:1789607362.282116:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0c700 x1876539149973504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607362.282123:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149973504:0@lo:400:kworker.0 00010000:00080000:1.0:1789607362.282133:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0e300 x1876539149974016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607362.282139:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149974016:0@lo:400:kworker.0 00000100:00100000:3.0:1789607362.282601:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149972608 00000100:00100000:3.0:1789607362.282609:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149972608 00000100:00080000:3.0:1789607362.282621:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607362.282626:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607362.282629:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607362.282632:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607362.282743:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149974400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607362.282775:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.287949:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789607362.287972:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+19:9907:x1876539149972608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.288342:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+19:9907:x1876539149972608:12345-0@lo:502:llog_process_th.0 Request processed in 372us (16004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.288350:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789607362.289130:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974272 00000100:00100000:2.0:1789607362.289144:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974272 00000100:00100000:2.0:1789607362.289427:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974400 00000100:00100000:2.0:1789607362.289432:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974400 00000100:00100000:2.0:1789607362.289460:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607362.289469:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149974272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607362.289477:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9907:1876539149972608:0@lo:502:llog_process_th.0 00002000:00000024:2.0:1789607362.289510:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000020:01000000:0.0:1789607362.289527:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607362.289535:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607362.289538:0:9907:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789607362.289544:0:9907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000100:00100000:2.0:1789607362.289569:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149974272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.289576:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607362.289595:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607362.289613:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149974400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607362.289625:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607362.289656:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149974400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (6880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.289662:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789607362.289706:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78faae3b80 x1876539149974400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607362.289723:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149974400:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789607362.289750:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78faae3480 x1876539149974272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607362.289762:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149974272:0@lo:13:osp-pre-1-0.0 00000020:01000000:1.0:1789607362.291548:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789607362.291579:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789607362.291589:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.291601:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607362.291612:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789607362.291614:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78f05a9800 from 48 10000000:01000000:1.0:1789607362.291629:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607362.292011:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.292094:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.292105:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.292129:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149974528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.292182:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.292220:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.292268:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974528 00000100:00100000:0.0:1789607362.292280:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974528 00000100:00100000:0.0:1789607362.292324:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789607362.292333:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:6466:x1876539149974528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607362.292345:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607362.292364:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d400/0xa26202d240fbd657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd650 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.292386:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d400/0xa26202d240fbd657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd650 expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.292397:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d400/0xa26202d240fbd657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd650 expref: 20 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.292404:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d400, rc 0) 00000100:00100000:0.0:1789607362.292447:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149974528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.292454:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789607362.292679:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149974528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607362.292694:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.292702:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.292754:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149974656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.292788:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.292804:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.292934:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974656 00000100:00100000:3.0:1789607362.292939:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974656 00000100:00100000:3.0:1789607362.292965:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789607362.292971:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149974656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.293197:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149974656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.293203:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789607362.294094:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149974656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.294136:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149974784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.294184:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.294218:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.294269:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974784 00000100:00100000:0.0:1789607362.294274:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974784 00000100:00100000:0.0:1789607362.294312:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789607362.294321:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149974784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.294487:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149974784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.294494:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789607362.294797:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149974784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.296647:0:9908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9908:1876539149974912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.296794:0:9908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.296831:0:9908:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.296926:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149974912 00000100:00100000:0.0:1789607362.296933:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149974912 00000100:00100000:0.0:1789607362.296972:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789607362.296981:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:9908:x1876539149974912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607362.297331:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:9908:x1876539149974912:12345-0@lo:502:llog_process_th.0 Request processed in 350us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.297338:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789607362.298125:0:9908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9908:1876539149974912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.298185:0:9908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9908:1876539149975040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.298228:0:9908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.298263:0:9908:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.298374:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975040 00000100:00100000:3.0:1789607362.298380:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975040 00000100:00100000:3.0:1789607362.298417:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789607362.298424:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:9908:x1876539149975040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.299506:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:9908:x1876539149975040:12345-0@lo:502:llog_process_th.0 Request processed in 1079us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.299526:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789607362.303787:0:9908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9908:1876539149975040:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789607362.305188:0:9908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789607362.306120:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789607362.306149:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607362.306160:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607362.306173:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607362.306184:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789607362.306201:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789607362.306204:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789607362.306240:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607362.306248:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607362.306259:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607362.306285:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.306345:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.306395:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.306451:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975168 00000100:00100000:0.0:1789607362.306458:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975168 00000100:00100000:0.0:1789607362.306506:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789607362.306525:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149975168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607362.306537:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607362.306549:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd65e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.306569:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd65e expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.306579:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd65e expref: 21 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.306586:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d600, rc 0) 00000100:00100000:0.0:1789607362.306631:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149975168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.306638:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789607362.307643:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607362.307678:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607362.307688:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607362.307754:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.307796:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.307837:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.308066:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975296 00000100:00100000:0.0:1789607362.308073:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975296 00000100:00100000:0.0:1789607362.308105:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789607362.308112:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149975296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.308363:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149975296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.308370:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789607362.308901:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.308940:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.308984:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607362.309131:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.309154:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975424 00000100:00100000:3.0:1789607362.309159:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975424 00000100:00100000:3.0:1789607362.309197:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789607362.309204:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149975424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.309371:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149975424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.309378:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789607362.309410:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.310314:0:9910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9910:1876539149975552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.310376:0:9910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.310412:0:9910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.310788:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975552 00000100:00100000:3.0:1789607362.310794:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975552 00000100:00100000:3.0:1789607362.310831:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789607362.310846:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:9910:x1876539149975552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.311344:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:9910:x1876539149975552:12345-0@lo:502:llog_process_th.0 Request processed in 504us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.311352:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789607362.315795:0:9910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9910:1876539149975552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607362.316808:0:9910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607362.316835:0:9910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607362.317132:0:9910:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789607362.317144:0:9910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789607362.317190:0:9910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9910:1876539149975680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.317265:0:9910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.317362:0:9910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.321146:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975680 00000100:00100000:3.0:1789607362.321164:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975680 00000100:00100000:3.0:1789607362.321260:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789607362.321272:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:9910:x1876539149975680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607362.321592:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:9910:x1876539149975680:12345-0@lo:502:llog_process_th.0 Request processed in 322us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.321600:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789607362.321704:0:9910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9910:1876539149975680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607362.321739:0:9910:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607362.321745:0:9910:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607362.321747:0:9910:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789607362.321752:0:9910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789607362.322646:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789607362.322677:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789607362.322687:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.322699:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607362.322711:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789607362.322713:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c75d7000 from 48 10000000:01000000:1.0:1789607362.322716:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607362.322750:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.322758:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.322768:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607362.322787:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.322831:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.325474:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.325732:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975808 00000100:00100000:0.0:1789607362.325743:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975808 00000100:00100000:2.0:1789607362.325802:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789607362.325816:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149975808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607362.325831:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607362.325857:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbd673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd66c expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.325919:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbd673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd66c expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.325930:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbd673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd66c expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.325938:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59cc00, rc 0) 00000100:00100000:2.0:1789607362.325995:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149975808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.326000:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789607362.326057:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607362.326087:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.326096:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607362.326157:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.326186:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.326200:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.326211:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149975936 00000100:00100000:2.0:1789607362.326215:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149975936 00000100:00100000:2.0:1789607362.326230:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789607362.326235:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149975936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.326481:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149975936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.326487:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789607362.326998:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149975936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.327046:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.327089:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.327106:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.327120:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976064 00000100:00100000:2.0:1789607362.327124:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976064 00000100:00100000:2.0:1789607362.327144:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789607362.327151:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149976064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.327294:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149976064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.327310:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789607362.327461:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.328751:0:9911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9911:1876539149976192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.328819:0:9911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.329114:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976192 00000100:00100000:2.0:1789607362.329121:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976192 00000100:00100000:2.0:1789607362.329151:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789607362.329159:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:9911:x1876539149976192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.329407:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:9911:x1876539149976192:12345-0@lo:502:llog_process_th.0 Request processed in 247us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.329415:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789607362.329453:0:9911:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.329472:0:9911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9911:1876539149976192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.329527:0:9911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9911:1876539149976320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.329560:0:9911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.329578:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976320 00000100:00100000:2.0:1789607362.329583:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976320 00000100:00100000:2.0:1789607362.329599:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789607362.329605:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:9911:x1876539149976320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607362.329715:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:9911:x1876539149976320:12345-0@lo:502:llog_process_th.0 Request processed in 110us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.329722:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789607362.329747:0:9911:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.329758:0:9911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9911:1876539149976320:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789607362.329782:0:9911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789607362.329827:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789607362.329854:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607362.329888:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.329898:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607362.329908:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789607362.329911:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789607362.329913:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789607362.329934:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.329941:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.329948:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607362.329960:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.329984:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.329998:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607362.330010:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976448 00000100:00100000:2.0:1789607362.330434:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976448 00000100:00100000:2.0:1789607362.330456:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789607362.330462:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149976448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607362.330471:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607362.330489:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d000/0xa26202d240fbd681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd67a expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.330985:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d000/0xa26202d240fbd681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd67a expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.331000:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59d000/0xa26202d240fbd681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd67a expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607362.331009:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d000, rc 0) 00000100:00100000:2.0:1789607362.331623:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149976448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1159us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.331631:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789607362.331905:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd591880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607362.331923:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607362.331949:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607362.332194:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.332508:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607362.332614:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.332723:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976576 00000100:00100000:3.0:1789607362.332730:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976576 00000100:00100000:3.0:1789607362.332767:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789607362.332775:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149976576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607362.333280:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149976576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 504us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607362.333288:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789607362.333645:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.333767:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.333812:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.334001:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607362.334233:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976704 00000100:00100000:3.0:1789607362.334239:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976704 00000100:00100000:2.0:1789607362.334523:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789607362.334532:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149976704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607362.334723:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149976704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607362.334730:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789607362.334803:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149976704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607362.335436:0:9912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9912:1876539149976832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607362.335479:0:9912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.336082:0:9912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.336231:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976832 00000100:00100000:0.0:1789607362.336238:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976832 00000100:00100000:0.0:1789607362.336273:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789607362.336281:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:9912:x1876539149976832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607362.336536:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:9912:x1876539149976832:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.336544:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789607362.337058:0:9912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9912:1876539149976832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607362.337089:0:9912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607362.337097:0:9912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607362.337099:0:9912:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789607362.337105:0:9912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789607362.337134:0:9912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9912:1876539149976960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607362.337173:0:9912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607362.337207:0:9912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.337310:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149976960 00000100:00100000:0.0:1789607362.337316:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149976960 00000100:00100000:0.0:1789607362.337336:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789607362.337342:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:9912:x1876539149976960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607362.337520:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:9912:x1876539149976960:12345-0@lo:502:llog_process_th.0 Request processed in 169us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.337526:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789607362.337754:0:9912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:9912:1876539149976960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607362.337773:0:9912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607362.337777:0:9912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607362.337779:0:9912:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789607362.337782:0:9912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789607362.338049:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789607362.338071:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789607362.338080:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338091:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607362.338110:0:6466:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789607362.338112:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78e9ee99c0 from 1 10000000:01000000:0.0:1789607362.338115:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789607362.338138:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338145:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338154:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607362.338168:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149977088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.338198:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607362.338219:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.338229:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977088 00000100:00100000:0.0:1789607362.338233:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977088 00000100:00100000:0.0:1789607362.338250:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789607362.338255:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149977088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607362.338263:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607362.338272:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd68f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd688 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338291:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd688 expref: 24 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338300:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd688 expref: 24 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338318:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075cc00, rc 0) 00000100:00100000:0.0:1789607362.338366:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149977088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607362.338372:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789607362.338396:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149977088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607362.338408:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.338416:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607362.338457:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149977216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.338481:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607362.338489:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607362.338503:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977216 00000100:00100000:0.0:1789607362.338508:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977216 00000100:00100000:0.0:1789607362.338535:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789607362.338541:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149977216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607362.339203:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149977216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 660us (719us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607362.339210:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789607362.339231:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149977216:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789607362.339250:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789607362.339255:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607362.339268:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607362.789321:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607363.462585:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607363.462691:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992576 00000100:00100000:0.0:1789607363.462701:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992576 00000100:00100000:0.0:1789607363.462768:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 242 00000100:00100000:0.0:1789607363.462779:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:6373:x1876539129992576:12345-192.168.203.25@tcp:101: 00010000:00010000:0.0:1789607363.462795:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607363.462814:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6687ce expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607363.462897:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687ce expref: 9 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607363.462909:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687ce expref: 9 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607363.462919:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d000, rc 0) 00000100:00100000:0.0:1789607363.462977:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129992576:12345-192.168.203.25@tcp:101: Request processed in 199us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607363.462985:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 242 00000100:00100000:3.0:1789607363.465821:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607363.466055:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992704 00000100:00100000:2.0:1789607363.466067:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992704 00000100:00100000:2.0:1789607363.466123:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 243 00000100:00100000:2.0:1789607363.466133:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129992704:12345-192.168.203.25@tcp:501: 00000100:00100000:2.0:1789607363.466424:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129992704:12345-192.168.203.25@tcp:501: Request processed in 292us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607363.466431:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 243 00000100:00100000:3.0:1789607363.475937:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607363.476402:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992832 00000100:00100000:2.0:1789607363.476437:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992832 00000100:00100000:2.0:1789607363.476498:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 244 00000100:00100000:2.0:1789607363.476507:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129992832:12345-192.168.203.25@tcp:503: 00000100:00100000:2.0:1789607363.476742:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129992832:12345-192.168.203.25@tcp:503: Request processed in 235us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607363.476751:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 244 00000100:00100000:3.0:1789607363.488285:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607363.488500:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129992960 00000100:00100000:0.0:1789607363.488510:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129992960 00000100:00100000:0.0:1789607363.488561:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 245 00000100:00100000:0.0:1789607363.488571:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6861:x1876539129992960:12345-192.168.203.25@tcp:502: 00000100:00100000:0.0:1789607363.489130:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6861:x1876539129992960:12345-192.168.203.25@tcp:502: Request processed in 557us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607363.489144:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 245 00000100:00100000:0.0:1789607363.495595:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607363.495996:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993088 00000100:00100000:3.0:1789607363.496006:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993088 00000100:00100000:3.0:1789607363.496061:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00100000:3.0:1789607363.496072:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6861:x1876539129993088:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607363.496369:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6861:x1876539129993088:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 297us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607363.496378:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00100000:3.0:1789607363.505218:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607363.505323:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993216 00000100:00100000:2.0:1789607363.505334:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993216 00000100:00100000:2.0:1789607363.505386:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00100000:2.0:1789607363.505396:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129993216:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607363.505412:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607363.505447:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbd69d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6687d5 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607363.505475:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbd69d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687d5 expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607363.505486:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbd69d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687d5 expref: 10 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607363.505495:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d800, rc 0) 00000100:00100000:2.0:1789607363.505550:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129993216:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 156us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607363.505556:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00100000:1.0:1789607363.509227:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607363.509338:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993344 00000100:00100000:0.0:1789607363.509348:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993344 00000100:00100000:0.0:1789607363.509407:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00100000:0.0:1789607363.509430:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129993344:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607363.509706:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129993344:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 290us (488us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607363.509715:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 248 00010000:00010000:1.0:1789607363.810149:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607364.326561:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607364.326584:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149977344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607364.326655:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607364.326822:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977344 00000100:00100000:3.0:1789607364.326839:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977344 00000100:00100000:3.0:1789607364.326924:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607364.326934:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149977344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607364.326966:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607364.327013:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149977344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607364.327020:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789607364.327061:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0b100 x1876539149977344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607364.327079:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149977344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607364.327259:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607364.327295:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149977472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607364.327322:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607364.327393:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977472 00000100:00100000:2.0:1789607364.327398:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977472 00000100:00100000:2.0:1789607364.327440:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789607364.327446:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149977472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607364.327458:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607364.327489:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149977472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607364.327496:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789607364.327996:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607364.328020:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703480 x1876539149977472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607364.328036:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149977472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607364.834034:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607364.834057:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149977600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607364.834121:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607364.834188:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977600 00000100:00100000:0.0:1789607364.834194:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977600 00000100:00100000:0.0:1789607364.834250:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607364.834259:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149977600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607364.834295:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607364.834339:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149977600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607364.834346:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607364.834390:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149977600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789607364.840747:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607365.350700:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149977728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607365.350786:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607365.350885:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977728 00000100:00100000:1.0:1789607365.350893:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977728 00000100:00100000:1.0:1789607365.350939:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607365.350948:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149977728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607365.350998:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607365.351059:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149977728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607365.351067:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607365.351114:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149977728:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789607365.488592:0:9951:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcd3e0560 20000000:00000080:3.0:1789607365.488609:0:9951:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d77c654e800 uarg=0000000000000000 20000000:01000000:3.0:1789607365.488642:0:9951:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789607365.488647:0:9951:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789607365.488652:0:9951:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789607365.489936:0:9952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789607365.490239:0:9951:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789607365.495750:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789607365.495807:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789607365.497339:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789607365.497382:0:9951:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789607365.497401:0:9951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497421:0:9951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd339 expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497429:0:9951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd347 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497436:0:9951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd39b expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497442:0:9951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497451:0:9951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 9 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497458:0:9951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497495:0:9951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 9 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497510:0:9951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 9 pid: 6462 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.497524:0:9951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149977856:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607365.497945:0:9951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.497965:0:9951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 23 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.497975:0:9951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149977984:0@lo:104: 00000100:00100000:3.0:1789607365.498015:0:9951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607365.498049:0:9951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd39b expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.498057:0:9951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd39b expref: 23 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.498065:0:9951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149978112:0@lo:104: 00000100:00100000:3.0:1789607365.498088:0:9951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607365.498112:0:9951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd347 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.498120:0:9951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd347 expref: 23 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.498129:0:9951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149978240:0@lo:104: 00010000:00010000:3.0:1789607365.498151:0:9951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd339 expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.498159:0:9951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd339 expref: 23 pid: 6463 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.498167:0:9951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149978368:0@lo:104: 00000100:00100000:3.0:1789607365.498184:0:9951:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607365.498261:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789607365.498281:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607365.498305:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607365.498313:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149977984 00000100:00100000:2.0:1789607365.498320:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149977984 00000100:00100000:2.0:1789607365.498354:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978112 00000100:00100000:2.0:1789607365.498356:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978112 00000100:00100000:2.0:1789607365.498367:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978240 00000100:00100000:2.0:1789607365.498369:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978240 00000100:00100000:2.0:1789607365.498377:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978368 00000100:00100000:2.0:1789607365.498380:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978368 00000100:00100000:2.0:1789607365.498390:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607365.498398:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+6:9951:x1876539149977984:12345-0@lo:104: 00010000:00010000:2.0:1789607365.498410:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498456:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607365.498462:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+6:9951:x1876539149977984:12345-0@lo:104: Request processed in 65us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.498469:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607365.498485:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607365.498499:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:9951:x1876539149978112:12345-0@lo:104: 00010000:00010000:2.0:1789607365.498507:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498536:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607365.498540:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:9951:x1876539149978112:12345-0@lo:104: Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.498546:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607365.498574:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607365.498580:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:9951:x1876539149978240:12345-0@lo:104: 00010000:00010000:2.0:1789607365.498587:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498618:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789607365.498622:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:9951:x1876539149978240:12345-0@lo:104: Request processed in 43us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.498627:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607365.498638:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607365.498644:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:9951:x1876539149978368:12345-0@lo:104: 00010000:00010000:2.0:1789607365.498651:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498675:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789607365.498680:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:9951:x1876539149978368:12345-0@lo:104: Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.498685:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789607365.498715:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789607365.498727:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498734:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607365.498738:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498746:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607365.498753:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607365.498759:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607365.498798:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498805:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607365.498823:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498830:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052400/0xa26202d240fbd4c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd4c8 expref: -99 pid: 9058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498858:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607365.498886:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498892:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607365.498895:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498912:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607365.498918:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607365.498924:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607365.498937:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498942:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607365.498948:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498954:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbd39b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd3a2 expref: -99 pid: 8107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498963:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607365.498966:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498970:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607365.498973:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.498978:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607365.498983:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607365.498994:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607365.499007:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499012:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607365.499025:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499031:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbd347 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd34e expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499041:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607365.499044:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499049:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607365.499052:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499058:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607365.499063:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607365.499067:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607365.499079:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499084:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607365.499096:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499103:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbd339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd340 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499115:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607365.499117:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607365.499118:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607365.499131:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149978624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499160:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607365.499184:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607365.499189:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149978496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499208:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607365.499231:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149978752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499250:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607365.499285:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607365.499290:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149978880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499311:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607365.499335:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978624 00000100:00100000:2.0:1789607365.499339:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978624 00010000:00010000:2.0:1789607365.499357:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd39b expref: 24 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607365.499369:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978496 00000100:00100000:2.0:1789607365.499371:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978496 00010000:00010000:2.0:1789607365.499378:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 25 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607365.499386:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978752 00000100:00100000:2.0:1789607365.499394:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978752 00010000:00010000:2.0:1789607365.499403:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd347 expref: 26 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607365.499412:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149978880 00000100:00100000:2.0:1789607365.499414:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149978880 00010000:00010000:2.0:1789607365.499421:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd339 expref: 27 pid: 6463 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607365.499431:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607365.499436:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+27:3471:x1876539149978624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607365.499444:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607365.499449:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd39b expref: 27 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499457:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd39b expref: 27 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499469:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607365.499494:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+27:3471:x1876539149978624:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.499500:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607365.499509:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607365.499514:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+26:3471:x1876539149978496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607365.499520:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607365.499523:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 26 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499530:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 26 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499549:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607365.499571:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+26:3471:x1876539149978496:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.499577:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607365.499591:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607365.499597:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+25:3468:x1876539149978752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607365.499603:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607365.499607:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd347 expref: 25 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499615:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd347 expref: 25 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499624:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607365.499647:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+25:3468:x1876539149978752:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.499653:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607365.499664:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607365.499670:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f06aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539149978880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607365.499677:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607365.499681:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd339 expref: 24 pid: 6463 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499688:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd339 expref: 24 pid: 6463 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.499697:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607365.499725:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f06aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539149978880:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.499731:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607365.499781:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149978496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499790:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149978624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499810:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149978880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607365.499816:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539149978752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607365.500003:0:9951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021dbe00/0xa26202d240fbd4c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd4c1 expref: 23 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.500015:0:9951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149977984:0@lo:104: 00010000:00010000:3.0:1789607365.500025:0:9951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd3a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd39b expref: 22 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.500032:0:9951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149978112:0@lo:104: 00010000:00010000:3.0:1789607365.500040:0:9951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184200/0xa26202d240fbd34e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd347 expref: 21 pid: 6462 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.500048:0:9951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149978240:0@lo:104: 00010000:00010000:3.0:1789607365.500056:0:9951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9185600/0xa26202d240fbd340 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd339 expref: 20 pid: 6463 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.500064:0:9951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149978368:0@lo:104: 00010000:00010000:1.0:1789607365.500903:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607365.500911:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607365.511610:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607365.511686:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993472 00000100:00100000:2.0:1789607365.511694:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993472 00010000:00010000:2.0:1789607365.511729:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 10 pid: 6462 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607365.511760:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1789607365.511769:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129993472:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607365.511782:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607365.511787:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 10 pid: 6462 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511798:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 10 pid: 6462 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511826:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511835:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511897:0:6456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511904:0:6456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511918:0:6456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511925:0:6456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511932:0:6456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607365.511936:0:6456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511944:0:6456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511953:0:6456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.511962:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607365.512021:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129993472:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 252us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607365.512029:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00010000:00010000:3.0:1789607365.512557:0:9951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd5e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668796 expref: 9 pid: 6462 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607365.512571:0:9951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9951:1876539149977856:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607365.512604:0:9951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.512612:0:9951:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.512618:0:9951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607365.512623:0:9951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd6a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607365.858125:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607366.149443:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607366.149484:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607366.149509:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607366.149533:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607366.149562:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993856 00000100:00100000:3.0:1789607366.149571:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993856 00000100:00100000:3.0:1789607366.149624:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993984 00000100:00100000:3.0:1789607366.149630:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993984 00000100:00100000:3.0:1789607366.149652:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:3.0:1789607366.149661:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129993856:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607366.149727:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129993856:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607366.149745:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:3.0:1789607366.149761:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1789607366.149767:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129993984:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607366.149793:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129993984:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607366.149799:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1789607366.149826:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993600 00000100:00100000:3.0:1789607366.149829:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993600 00000100:00100000:3.0:1789607366.149882:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129993728 00000100:00100000:3.0:1789607366.149885:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129993728 00000100:00100000:3.0:1789607366.149905:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:3.0:1789607366.149912:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539129993600:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607366.149941:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539129993600:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607366.149960:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:3.0:1789607366.149972:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:3.0:1789607366.149978:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129993728:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607366.150013:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129993728:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 35us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607366.150019:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00080000:3.0:1789607366.150037:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607366.150040:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607366.150043:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607366.150044:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607366.853251:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607366.855236:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994112 00000100:00100000:2.0:1789607366.855250:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994112 00000100:00100000:2.0:1789607366.855314:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00100000:2.0:1789607366.855337:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:6373:x1876539129994112:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607366.855354:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607366.855373:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6687dc expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607366.855401:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 10 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607366.855412:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 10 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607366.855421:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d400, rc 0) 00000100:00100000:2.0:1789607366.855482:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129994112:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 147us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607366.855489:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00100000:3.0:1789607366.879642:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607366.879748:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994240 00000100:00100000:0.0:1789607366.879762:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994240 00000100:00100000:0.0:1789607366.879844:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 250 00000100:00100000:0.0:1789607366.879856:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129994240:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607366.880167:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129994240:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 313us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607366.880174:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 250 00010000:00010000:0.0:1789607366.882461:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607366.897491:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607366.898110:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994368 00000100:00100000:0.0:1789607366.898119:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994368 00000100:00100000:0.0:1789607366.898175:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 251 00000100:00100000:0.0:1789607366.898184:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129994368:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607366.898383:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6373:x1876539129994368:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 199us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607366.898391:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 251 00000100:00100000:0.0:1789607366.912335:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607366.912397:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994496 00000100:00100000:3.0:1789607366.912407:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994496 00000100:00100000:3.0:1789607366.912496:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 252 00000100:00100000:3.0:1789607366.912509:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6918:x1876539129994496:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607366.912737:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6918:x1876539129994496:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 230us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607366.912745:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 252 00000100:00100000:3.0:1789607366.940064:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607366.940213:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994624 00000100:00100000:1.0:1789607366.940226:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994624 00000100:00100000:1.0:1789607366.940282:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 253 00000100:00100000:1.0:1789607366.940292:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6918:x1876539129994624:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607366.940537:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:6918:x1876539129994624:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 245us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607366.940545:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 253 10000000:01000000:2.0:1789607367.009978:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607367.009984:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f77e7800 from 4 10000000:01000000:2.0:1789607367.009990:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607367.010034:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.010047:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.010057:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607367.010084:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.010148:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.010208:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607367.010267:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979008 00000100:00100000:0.0:1789607367.010275:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979008 00000100:00100000:0.0:1789607367.010327:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789607367.010336:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539149979008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607367.010350:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607367.010362:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd6b2 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607367.010385:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607367.010395:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607367.010403:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c800, rc 0) 00000100:00100000:0.0:1789607367.010454:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149979008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607367.010460:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789607367.010569:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607367.010584:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.010593:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607367.010654:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.010689:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.010705:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.010718:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979136 00000100:00100000:3.0:1789607367.010721:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979136 00000100:00100000:3.0:1789607367.010744:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789607367.010751:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149979136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.011009:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149979136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.011015:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789607367.011045:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.011068:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.011103:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.011117:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.011127:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979264 00000100:00100000:3.0:1789607367.011131:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979264 00000100:00100000:3.0:1789607367.011151:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789607367.011157:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149979264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.011283:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149979264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.011289:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789607367.011324:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.011480:0:10008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10008:1876539149979392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607367.011518:0:10008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.011535:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979392 00000100:00100000:3.0:1789607367.011538:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979392 00000100:00100000:3.0:1789607367.011558:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789607367.011564:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:10008:x1876539149979392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607367.011668:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:10008:x1876539149979392:12345-0@lo:502:llog_process_th.0 Request processed in 103us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.011675:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789607367.011704:0:10008:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.011716:0:10008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10008:1876539149979392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607367.011735:0:10008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607367.011743:0:10008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607367.011745:0:10008:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789607367.011752:0:10008:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78f77e7800 00000020:00000080:3.0:1789607367.011754:0:10008:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789607367.013689:0:10008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10008:1876539149979520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607367.013757:0:10008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.013793:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979520 00000100:00100000:3.0:1789607367.013799:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979520 00000100:00100000:3.0:1789607367.026510:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789607367.026529:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:10008:x1876539149979520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607367.026784:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:10008:x1876539149979520:12345-0@lo:502:llog_process_th.0 Request processed in 262us (13028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.026792:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789607367.036103:0:10008:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.036144:0:10008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10008:1876539149979520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607367.036191:0:10008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607367.036198:0:10008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607367.036201:0:10008:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789607367.036205:0:10008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789607367.036268:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789607367.036284:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607367.036294:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036306:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607367.036316:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607367.036319:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7901022000 from 4 10000000:01000000:3.0:1789607367.036321:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607367.036353:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036362:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036371:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607367.036390:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.036444:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.036469:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.036483:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979648 00000100:00100000:3.0:1789607367.036489:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979648 00000100:00100000:3.0:1789607367.036525:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789607367.036533:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539149979648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607367.036551:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607367.036562:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd6c0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036583:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036594:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036600:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e600, rc 0) 00000100:00100000:3.0:1789607367.036632:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149979648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.036638:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789607367.036685:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607367.036697:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.036706:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607367.036743:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.036765:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.036777:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.036789:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979776 00000100:00100000:3.0:1789607367.036792:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979776 00000100:00100000:3.0:1789607367.036822:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789607367.036837:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149979776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.038215:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149979776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1374us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.038225:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789607367.038283:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.038323:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.038366:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.038390:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.038403:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149979904 00000100:00100000:3.0:1789607367.038407:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149979904 00000100:00100000:3.0:1789607367.038434:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789607367.038441:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149979904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.038576:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149979904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.038583:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789607367.038617:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149979904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607367.055993:0:10012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10012:1876539149980032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607367.056073:0:10012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.056118:0:10012:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f06a3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.057914:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980032 00000100:00100000:3.0:1789607367.057927:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980032 00000100:00100000:2.0:1789607367.058037:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789607367.058050:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:10012:x1876539149980032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.058294:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:10012:x1876539149980032:12345-0@lo:502:llog_process_th.0 Request processed in 247us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.058302:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789607367.058387:0:10012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10012:1876539149980032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607367.058420:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607367.058430:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607367.058433:0:10012:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789607367.058440:0:10012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7901022000 00000020:00000080:1.0:1789607367.058443:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789607367.058529:0:10012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10012:1876539149980160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607367.058573:0:10012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.058598:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980160 00000100:00100000:3.0:1789607367.058603:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980160 00000100:00100000:1.0:1789607367.058611:0:10012:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f06a3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607367.058636:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789607367.058644:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:10012:x1876539149980160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607367.060941:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:10012:x1876539149980160:12345-0@lo:502:llog_process_th.0 Request processed in 2291us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.060953:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789607367.065313:0:10012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10012:1876539149980160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607367.065361:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607367.065369:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607367.065372:0:10012:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789607367.065378:0:10012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789607367.070333:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789607367.070369:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607367.070381:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.070394:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607367.070406:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607367.070408:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f05a9800 from 4 10000000:01000000:3.0:1789607367.070411:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607367.070443:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.070451:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607367.070461:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607367.070484:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607367.070544:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.070592:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c30716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.074951:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980288 00000100:00100000:2.0:1789607367.074965:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980288 00000100:00100000:2.0:1789607367.075035:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789607367.075046:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539149980288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607367.075062:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607367.075079:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd6ce expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.075105:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.075116:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.075125:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59da00, rc 0) 00000100:00100000:2.0:1789607367.075200:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149980288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.075207:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789607367.075261:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607367.075278:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.075300:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607367.075368:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.075402:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.075428:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.075440:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980416 00000100:00100000:2.0:1789607367.075444:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980416 00000100:00100000:2.0:1789607367.075462:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789607367.075467:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149980416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.076495:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149980416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1023us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.076504:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789607367.076545:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.076580:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.076620:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.077899:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.078051:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980544 00000100:00100000:2.0:1789607367.078059:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980544 00000100:00100000:2.0:1789607367.078098:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789607367.078106:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149980544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.080709:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149980544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2595us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.080722:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789607367.080810:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.081049:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10016:1876539149980672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.081105:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.081128:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980672 00000100:00100000:2.0:1789607367.081135:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980672 00000100:00100000:2.0:1789607367.081165:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789607367.081173:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:10016:x1876539149980672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.081359:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:10016:x1876539149980672:12345-0@lo:502:llog_process_th.0 Request processed in 186us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.081366:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789607367.081403:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.081415:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10016:1876539149980672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607367.081437:0:10016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607367.081445:0:10016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607367.081447:0:10016:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607367.081453:0:10016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78f05a9800 00000020:00000080:2.0:1789607367.081456:0:10016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607367.081752:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10016:1876539149980800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.081785:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.081807:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980800 00000100:00100000:2.0:1789607367.081810:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980800 00000100:00100000:2.0:1789607367.081846:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789607367.081853:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:10016:x1876539149980800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.081983:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:10016:x1876539149980800:12345-0@lo:502:llog_process_th.0 Request processed in 130us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.081990:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789607367.082023:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.082034:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10016:1876539149980800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607367.082052:0:10016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607367.082056:0:10016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607367.082057:0:10016:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789607367.082061:0:10016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789607367.082103:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789607367.082116:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607367.082124:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082134:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607367.082144:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607367.082147:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c75d7000 from 4 10000000:01000000:2.0:1789607367.082149:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607367.082172:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082180:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082189:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607367.082201:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.082227:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.082245:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.082255:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149980928 00000100:00100000:2.0:1789607367.082264:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149980928 00000100:00100000:2.0:1789607367.082283:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789607367.082290:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539149980928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607367.082298:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607367.082310:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd6dc expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082330:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 24 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082339:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 24 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082348:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59c200, rc 0) 00000100:00100000:2.0:1789607367.082375:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149980928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.082380:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789607367.082405:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149980928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607367.082415:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.082423:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607367.082460:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149981056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.082481:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.082492:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.082502:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981056 00000100:00100000:2.0:1789607367.082510:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981056 00000100:00100000:2.0:1789607367.082529:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789607367.082535:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149981056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.082716:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149981056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.082723:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789607367.082751:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149981056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.082775:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149981184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.082806:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.082819:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.083660:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981184 00000100:00100000:2.0:1789607367.083668:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981184 00000100:00100000:2.0:1789607367.083697:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789607367.083704:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149981184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.085191:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539149981184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1482us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.085202:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789607367.085264:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539149981184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607367.091307:0:10019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10019:1876539149981312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.091388:0:10019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.091427:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981312 00000100:00100000:2.0:1789607367.091434:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981312 00000100:00100000:2.0:1789607367.091474:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789607367.091484:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:10019:x1876539149981312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.091687:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:10019:x1876539149981312:12345-0@lo:502:llog_process_th.0 Request processed in 203us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.091700:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789607367.091746:0:10019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.091837:0:10019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10019:1876539149981312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607367.091877:0:10019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607367.091885:0:10019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607367.091887:0:10019:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607367.091893:0:10019:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78c75d7000 00000020:00000080:2.0:1789607367.091895:0:10019:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607367.091959:0:10019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10019:1876539149981440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.092050:0:10019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607367.092069:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981440 00000100:00100000:2.0:1789607367.092072:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981440 00000100:00100000:2.0:1789607367.092090:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789607367.092095:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:10019:x1876539149981440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607367.092186:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:10019:x1876539149981440:12345-0@lo:502:llog_process_th.0 Request processed in 89us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607367.092193:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789607367.092219:0:10019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607367.092230:0:10019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:10019:1876539149981440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607367.092247:0:10019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607367.092251:0:10019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607367.092253:0:10019:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789607367.092257:0:10019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789607367.092296:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789607367.092312:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607367.092321:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607367.092339:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607367.394272:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149981568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607367.394345:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607367.394417:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981568 00000100:00100000:3.0:1789607367.394425:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981568 00000100:00100000:3.0:1789607367.394476:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607367.394485:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149981568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607367.394561:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607367.394606:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149981568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.394638:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789607367.394669:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607367.394695:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0a80 x1876539149981568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607367.394713:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149981568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607367.396308:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607367.396323:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149981696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607367.396372:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.396415:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981696 00000100:00100000:1.0:1789607367.396421:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981696 00000100:00100000:1.0:1789607367.396461:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789607367.396469:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149981696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607367.396486:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607367.396524:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149981696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607367.396530:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789607367.396550:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789607367.396574:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78faae1c00 x1876539149981696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607367.396591:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149981696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607367.396899:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149982208:0@lo:400:kworker.0 00000100:00100000:0.0:1789607367.396931:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607367.396953:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149982720:0@lo:400:kworker.0 00000100:00100000:0.0:1789607367.396985:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607367.397004:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789607367.397009:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149982080:0@lo:400:kworker.0 00000100:00100000:0.0:1789607367.397050:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607367.397066:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149982592:0@lo:400:kworker.0 00000100:00100000:0.0:1789607367.397085:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607367.397108:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982208 00000100:00100000:0.0:1789607367.397111:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982208 00000100:00100000:0.0:1789607367.397138:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789607367.397143:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149982208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607367.397180:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149982208:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607367.397186:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789607367.397210:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149982208:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397368:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149981952:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397396:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.397420:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149982464:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397440:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.397471:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149982976:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397493:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.397511:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789607367.397516:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149981824:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397538:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.397554:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149982336:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397572:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.397581:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149982848:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.397598:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607367.397617:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981952 00000100:00100000:1.0:1789607367.397621:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981952 00000100:00100000:1.0:1789607367.397648:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607367.397653:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149981952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.397792:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982720 00000100:00100000:3.0:1789607367.397805:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982720 00000100:00100000:3.0:1789607367.397850:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982592 00000100:00100000:3.0:1789607367.397853:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982592 00000100:00100000:3.0:1789607367.397901:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607367.397908:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149982720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.397951:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149982720:12345-0@lo:400:kworker.0 Request processed in 44us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.397957:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607367.397980:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607367.397986:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149982592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398014:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149982592:12345-0@lo:400:kworker.0 Request processed in 30us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398020:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607367.398036:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982080 00000100:00100000:3.0:1789607367.398041:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982080 00000100:00100000:3.0:1789607367.398058:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982464 00000100:00100000:3.0:1789607367.398060:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982464 00000100:00100000:3.0:1789607367.398070:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982976 00000100:00100000:3.0:1789607367.398072:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982976 00000100:00100000:3.0:1789607367.398082:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149981824 00000100:00100000:3.0:1789607367.398084:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149981824 00000100:00100000:3.0:1789607367.398103:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982336 00000100:00100000:3.0:1789607367.398106:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982336 00000100:00100000:3.0:1789607367.398115:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149982848 00000100:00100000:3.0:1789607367.398117:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149982848 00000100:00100000:3.0:1789607367.398127:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607367.398132:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398159:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149982080:12345-0@lo:400:kworker.0 Request processed in 26us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398164:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607367.398174:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607367.398179:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149982464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398210:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149982464:12345-0@lo:400:kworker.0 Request processed in 31us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398215:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607367.398225:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607367.398231:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149982976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398255:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149982976:12345-0@lo:400:kworker.0 Request processed in 24us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398260:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607367.398271:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789607367.398277:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149981824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398299:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149981824:12345-0@lo:400:kworker.0 Request processed in 23us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398304:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789607367.398313:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607367.398318:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149982336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398349:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149982336:12345-0@lo:400:kworker.0 Request processed in 31us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398354:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607367.398365:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789607367.398369:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149982848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607367.398389:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149982848:12345-0@lo:400:kworker.0 Request processed in 20us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607367.398394:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789607367.398428:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149982080:0@lo:400:kworker.0 00010000:00080000:3.0:1789607367.398439:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0701500 x1876539149982592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607367.398449:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149982592:0@lo:400:kworker.0 00010000:00080000:3.0:1789607367.398458:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0701f80 x1876539149982720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607367.398466:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149982720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.399047:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149981952:12345-0@lo:400:kworker.0 Request processed in 1392us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607367.399054:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607367.399090:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149981824:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.399100:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149982336:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.399110:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149982848:0@lo:400:kworker.0 00000100:00100000:1.0:1789607367.399119:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149981952:0@lo:400:kworker.0 00010000:00080000:1.0:1789607367.399129:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700000 x1876539149982464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607367.399138:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149982464:0@lo:400:kworker.0 00010000:00080000:1.0:1789607367.399161:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80700 x1876539149982976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607367.399170:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149982976:0@lo:400:kworker.0 00000100:00080000:0.0:1789607367.399280:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607367.399285:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607367.399287:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607367.906168:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607368.930203:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607369.443668:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149983232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607369.443732:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607369.443819:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607369.443826:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149983104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607369.443848:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607369.443850:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983232 00000100:00100000:0.0:1789607369.443879:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983232 00000100:00100000:1.0:1789607369.443903:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983104 00000100:00100000:1.0:1789607369.443908:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983104 00000100:00080000:2.0:1789607369.444021:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607369.444057:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607369.444068:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149983104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607369.444101:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607369.444149:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149983104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607369.457886:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789607369.457916:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149983232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607369.458637:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607369.459568:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149983232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1664us (15831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607369.459579:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789607369.459652:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0b480 x1876539149983104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607369.460082:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149983104:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789607369.460103:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700000 x1876539149983232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607369.461611:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149983232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607369.463266:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607369.956906:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149983360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607369.957010:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607369.957333:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983360 00000100:00100000:3.0:1789607369.957343:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983360 00000100:00100000:3.0:1789607369.957394:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789607369.957403:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149983360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607369.957453:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607369.957502:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149983360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607369.957524:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1789607369.957549:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607369.957582:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149983360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607370.466281:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149983488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607370.466364:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607370.466450:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983488 00000100:00100000:1.0:1789607370.466458:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983488 00000100:00100000:1.0:1789607370.466509:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789607370.466518:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149983488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607370.466563:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607370.466610:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149983488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607370.466631:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789607370.466681:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149983488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607370.979328:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607371.277178:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607371.277306:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607371.277337:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607371.277369:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607371.277393:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607371.278450:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995008 00000100:00100000:3.0:1789607371.278470:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995008 00000100:00100000:3.0:1789607371.278528:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994880 00000100:00100000:3.0:1789607371.278531:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994880 00000100:00100000:3.0:1789607371.278562:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1789607371.278571:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129995008:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607371.278644:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129995008:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 74us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607371.278650:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1789607371.278668:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:3.0:1789607371.278675:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539129994880:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607371.278698:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539129994880:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607371.278704:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:3.0:1789607371.278723:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995264 00000100:00100000:3.0:1789607371.278727:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995264 00000100:00100000:3.0:1789607371.278751:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995136 00000100:00100000:3.0:1789607371.278754:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995136 00000100:00100000:3.0:1789607371.278773:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:3.0:1789607371.278780:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129995264:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607371.278815:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129995264:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 35us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607371.279070:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1789607371.279082:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129995136:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607371.279109:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129995136:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 32us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607371.279115:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:3.0:1789607371.279990:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:2.0:1789607371.286048:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129994752 00000100:00100000:2.0:1789607371.286063:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129994752 00000100:00100000:2.0:1789607371.286116:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 274 00000100:00100000:2.0:1789607371.286124:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129994752:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607371.286221:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129994752:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 86us (9041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607371.286228:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 274 00000100:00080000:2.0:1789607371.286268:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607371.286273:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607371.286276:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607371.286279:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789607372.006997:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607372.515668:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607372.515694:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149983616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607372.515761:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607372.515885:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983616 00000100:00100000:3.0:1789607372.515891:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983616 00000100:00100000:3.0:1789607372.515945:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607372.515954:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149983616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607372.515987:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607372.516025:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149983616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607372.516031:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789607372.516052:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607372.516066:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149983744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607372.516089:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789607372.516123:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0ca80 x1876539149983616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607372.516141:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149983616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607372.526154:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983744 00000100:00100000:1.0:1789607372.526165:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983744 00000100:00100000:1.0:1789607372.526229:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607372.526241:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149983744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607372.526262:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607372.526348:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149983744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (10258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.526354:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607372.526382:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149984000:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526418:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526441:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149984512:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526462:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526482:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149985024:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526503:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526525:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789607372.526531:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149983872:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526556:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526583:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149984384:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526618:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526637:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149984896:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526658:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526687:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149984128:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.526709:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.526739:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149984640:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527051:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.527087:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149985152:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527110:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.527297:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789607372.527306:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149984256:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527383:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.527397:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149984768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527419:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607372.527446:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984000 00000100:00100000:1.0:1789607372.527452:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984000 00000100:00100000:1.0:1789607372.527478:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984512 00000100:00100000:1.0:1789607372.527481:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984512 00000100:00100000:1.0:1789607372.527495:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985024 00000100:00100000:1.0:1789607372.527498:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985024 00000100:00100000:1.0:1789607372.527509:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984640 00000100:00100000:1.0:1789607372.527511:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984640 00000100:00100000:1.0:1789607372.527520:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985152 00000100:00100000:1.0:1789607372.527521:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985152 00000100:00100000:1.0:1789607372.527532:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984256 00000100:00100000:1.0:1789607372.527534:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984256 00000100:00100000:1.0:1789607372.527545:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789607372.527551:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149984000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527599:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539149984000:12345-0@lo:400:kworker.0 Request processed in 48us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.527606:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789607372.527620:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789607372.527626:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149984512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527652:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539149984512:12345-0@lo:400:kworker.0 Request processed in 27us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.527658:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789607372.527669:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789607372.527675:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149985024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.527699:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539149985024:12345-0@lo:400:kworker.0 Request processed in 24us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.527705:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789607372.527717:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789607372.529156:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607372.529172:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149985152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607372.529244:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539149985152:12345-0@lo:400:kworker.0 Request processed in 78us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607372.529251:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607372.529276:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607372.529284:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149984256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607372.529328:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149984256:12345-0@lo:400:kworker.0 Request processed in 46us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607372.529334:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607372.529354:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984896 00000100:00100000:3.0:1789607372.529361:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984896 00000100:00080000:2.0:1789607372.529362:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607372.529367:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607372.529369:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607372.529371:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607372.529389:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984768 00000100:00100000:3.0:1789607372.529392:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984768 00010000:00080000:2.0:1789607372.529404:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d09880 x1876539149983744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607372.529413:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607372.529418:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149984896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607372.529424:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149983744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607372.529447:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149984896:12345-0@lo:400:kworker.0 Request processed in 29us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607372.529453:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607372.529464:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607372.529469:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149984768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607372.529493:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149984768:12345-0@lo:400:kworker.0 Request processed in 24us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607372.529498:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789607372.529512:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607372.529528:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149984256:0@lo:400:kworker.0 00010000:00080000:2.0:1789607372.529547:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc905880 x1876539149984768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607372.529555:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149984768:0@lo:400:kworker.0 00010000:00080000:2.0:1789607372.529564:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6581500 x1876539149985152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607372.529571:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539149985152:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.529995:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149984640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530040:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539149984640:12345-0@lo:400:kworker.0 Request processed in 2318us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.530046:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789607372.530074:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149983872 00000100:00100000:1.0:1789607372.530078:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149983872 00000100:00100000:1.0:1789607372.530114:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789607372.530128:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539149983872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530159:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539149983872:12345-0@lo:400:kworker.0 Request processed in 40us (3603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.530165:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789607372.530201:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984384 00000100:00100000:1.0:1789607372.530205:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984384 00000100:00100000:1.0:1789607372.530241:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149984128 00000100:00100000:1.0:1789607372.530244:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149984128 00000100:00100000:1.0:1789607372.530257:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607372.530262:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149984384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530294:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149984384:12345-0@lo:400:kworker.0 Request processed in 31us (3675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.530299:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607372.530310:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789607372.530315:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149984128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530352:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149984128:12345-0@lo:400:kworker.0 Request processed in 37us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607372.530358:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789607372.530397:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539149983872:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530410:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149984384:0@lo:400:kworker.0 00010000:00080000:1.0:1789607372.530423:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5bd1c00 x1876539149984896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607372.530432:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149984896:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530443:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539149984000:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530454:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539149984512:0@lo:400:kworker.0 00000100:00100000:1.0:1789607372.530465:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539149985024:0@lo:400:kworker.0 00000100:00100000:2.0:1789607372.531661:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149984128:0@lo:400:kworker.0 00010000:00080000:2.0:1789607372.531683:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc905c00 x1876539149984640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607372.531692:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539149984640:0@lo:400:kworker.0 00010000:00010000:0.0:1789607373.040083:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607374.058554:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607374.562122:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607374.562143:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149985280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607374.562209:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607374.562355:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985280 00000100:00100000:3.0:1789607374.562362:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985280 00000100:00100000:3.0:1789607374.562413:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607374.562423:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149985280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607374.562458:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607374.562505:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149985280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607374.562511:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607374.562531:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607374.562554:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149985408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607374.562585:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789607374.562610:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607374.562620:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985408 00000100:00100000:3.0:1789607374.562624:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985408 00000100:00100000:3.0:1789607374.562647:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607374.562653:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149985408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607374.562662:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607374.562690:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149985408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607374.562695:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789607374.562711:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607374.562735:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d09880 x1876539149985408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607374.562753:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149985408:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789607374.562787:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e1c00 x1876539149985280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607374.562797:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149985280:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1789607374.872460:0:10254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789607375.075026:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149985536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607375.075090:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607375.075154:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607375.075167:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985536 00000100:00100000:3.0:1789607375.075173:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985536 00000100:00100000:3.0:1789607375.075214:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607375.075222:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149985536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607375.075261:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607375.075317:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149985536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607375.075324:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607375.075369:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149985536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607375.593835:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149985664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607375.593947:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607375.594027:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985664 00000100:00100000:3.0:1789607375.594035:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985664 00000100:00100000:3.0:1789607375.594079:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607375.594088:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149985664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607375.594126:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607375.594168:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149985664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607375.594176:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607375.594223:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149985664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607376.101773:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607376.400182:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607376.400224:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607376.400251:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607376.400276:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995648 00000100:00100000:1.0:1789607376.400285:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995648 00000100:00100000:1.0:1789607376.400342:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995520 00000100:00100000:1.0:1789607376.400346:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995520 00000100:00100000:1.0:1789607376.400369:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1789607376.400378:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129995648:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607376.400449:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129995648:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 72us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607376.400456:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1789607376.400478:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:1.0:1789607376.400484:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129995520:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607376.400506:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129995520:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607376.400512:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00080000:1.0:1789607376.400528:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607376.400532:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607376.400683:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995392 00000100:00100000:3.0:1789607376.400687:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995392 00000100:00100000:3.0:1789607376.400718:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 276 00000100:00100000:3.0:1789607376.400725:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129995392:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607376.400753:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129995392:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607376.400771:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 276 00000100:00100000:2.0:1789607376.435744:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607376.435802:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607376.435890:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995776 00000100:00100000:0.0:1789607376.435900:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995776 00000100:00100000:0.0:1789607376.435977:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129995904 00000100:00100000:0.0:1789607376.435980:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129995904 00000100:00100000:0.0:1789607376.436012:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:0.0:1789607376.436022:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2392:x1876539129995776:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:0.0:1789607376.436057:0:8114:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5f5 00000100:00080000:0.0:1789607376.436080:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607376.436117:0:8114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789607376.436383:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+2:2392:x1876539129995776:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 361us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607376.436391:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:0.0:1789607376.436407:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607376.436414:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790030d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2392:x1876539129995904:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:0.0:1789607376.436427:0:8114:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5fc 00000100:00080000:0.0:1789607376.436433:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ba7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607376.436453:0:8114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789607376.436587:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790030d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+2:2392:x1876539129995904:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 172us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607376.436594:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00010000:00010000:3.0:1789607376.437394:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607376.437443:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607376.437448:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607376.437687:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789607376.714574:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:2.0:1789607376.714584:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d78f77e4000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:0.0:1789607376.714960:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e4000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-OST0000 00000020:00000080:0.0:1789607376.715008:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f77e7000 for lustre-OST0000 00010000:00010000:0.0:1789607377.123290:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607377.634245:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149985792:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634316:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634367:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149986304:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634390:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634414:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149986816:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634433:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634450:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149987328:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634465:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634485:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789607377.634491:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149986176:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634511:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634524:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149986688:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634539:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634550:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149987200:0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634566:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607377.634591:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986816 00000100:00100000:2.0:1789607377.634598:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986816 00000100:00100000:2.0:1789607377.634651:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987328 00000100:00100000:2.0:1789607377.634654:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987328 00000100:00100000:2.0:1789607377.634665:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986688 00000100:00100000:2.0:1789607377.634667:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986688 00000100:00100000:2.0:1789607377.634676:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987200 00000100:00100000:2.0:1789607377.634678:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987200 00000100:00100000:2.0:1789607377.634692:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607377.634699:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149986816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634744:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149986816:12345-0@lo:400:kworker.0 Request processed in 46us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.634762:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607377.634776:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607377.634781:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149987328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634805:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149987328:12345-0@lo:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.634817:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607377.634828:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607377.634833:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149986688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634858:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149986688:12345-0@lo:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.634882:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607377.634892:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607377.634898:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149987200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.634920:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149987200:12345-0@lo:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.634924:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789607377.634956:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6581500 x1876539149986688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607377.634969:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149986688:0@lo:400:kworker.0 00010000:00080000:2.0:1789607377.634978:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd81f80 x1876539149987200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607377.634985:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149987200:0@lo:400:kworker.0 00010000:00080000:2.0:1789607377.634994:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5bd3b80 x1876539149986816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607377.635001:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149986816:0@lo:400:kworker.0 00010000:00080000:2.0:1789607377.635009:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80700 x1876539149987328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607377.635016:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149987328:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.635309:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985792 00000100:00100000:1.0:1789607377.635314:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985792 00000100:00100000:1.0:1789607377.635354:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789607377.635362:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149985792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.635406:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149985792:12345-0@lo:400:kworker.0 Request processed in 46us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607377.635413:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789607377.635448:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986176 00000100:00100000:1.0:1789607377.635452:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986176 00000100:00100000:1.0:1789607377.635477:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789607377.635484:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149986176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.635515:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149986176:12345-0@lo:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607377.635521:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789607377.635540:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607377.635543:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607377.635566:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149986176:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.635575:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149985792:0@lo:400:kworker.0 00000100:00100000:3.0:1789607377.635945:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149985920:0@lo:400:kworker.0 00000100:00100000:3.0:1789607377.635982:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607377.636014:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149986432:0@lo:400:kworker.0 00000100:00100000:3.0:1789607377.636038:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607377.636055:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149986944:0@lo:400:kworker.0 00000100:00100000:3.0:1789607377.636074:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607377.636240:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986304 00000100:00100000:1.0:1789607377.636245:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986304 00000100:00100000:1.0:1789607377.636274:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607377.636280:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149986304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.636323:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149986304:12345-0@lo:400:kworker.0 Request processed in 43us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607377.636330:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607377.636350:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149986048:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.636375:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607377.636394:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149986560:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.636428:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607377.636449:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149987072:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.636471:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607377.636482:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149987584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607377.636515:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607377.636560:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149985920 00000100:00100000:1.0:1789607377.636564:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149985920 00000100:00100000:1.0:1789607377.636581:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986432 00000100:00100000:1.0:1789607377.636584:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986432 00000100:00100000:1.0:1789607377.636602:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986944 00000100:00100000:1.0:1789607377.636604:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986944 00000100:00100000:2.0:1789607377.637235:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986048 00000100:00100000:2.0:1789607377.637241:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986048 00000100:00100000:2.0:1789607377.637270:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607377.637277:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149986048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.637330:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149986048:12345-0@lo:400:kworker.0 Request processed in 54us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.637336:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607377.637352:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149986560 00000100:00100000:2.0:1789607377.637355:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149986560 00000100:00100000:2.0:1789607377.637370:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987072 00000100:00100000:2.0:1789607377.637372:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987072 00000100:00100000:2.0:1789607377.637384:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789607377.637390:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149985920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.637419:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149985920:12345-0@lo:400:kworker.0 Request processed in 29us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.637425:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789607377.637442:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789607377.637450:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149986432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.637478:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149986432:12345-0@lo:400:kworker.0 Request processed in 31us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.637483:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789607377.637494:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789607377.637500:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149986944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.637526:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149986944:12345-0@lo:400:kworker.0 Request processed in 27us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.637531:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789607377.637551:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789607377.637557:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149986560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.637586:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149986560:12345-0@lo:400:kworker.0 Request processed in 29us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.637591:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789607377.637602:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789607377.637744:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607377.637756:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607377.637786:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149986048:0@lo:400:kworker.0 00010000:00080000:1.0:1789607377.637797:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6580a80 x1876539149986560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607377.637806:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149986560:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.637838:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149986304:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.637911:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987584 00000100:00100000:1.0:1789607377.637915:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987584 00000100:00100000:1.0:1789607377.637939:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607377.637945:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149987584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607377.637972:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607377.638008:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149987584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607377.638014:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789607377.638701:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149987072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607377.638757:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149987072:12345-0@lo:400:kworker.0 Request processed in 1141us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607377.638765:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1789607377.638928:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd82300 x1876539149987072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607377.638939:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149987072:0@lo:400:kworker.0 00010000:00080000:1.0:1789607377.638949:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80700 x1876539149987584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607377.638974:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149987584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607377.639052:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149987456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607377.639431:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607377.639477:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149985920:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.639489:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149986432:0@lo:400:kworker.0 00000100:00100000:1.0:1789607377.639499:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149986944:0@lo:400:kworker.0 00000100:00100000:3.0:1789607377.641724:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987456 00000100:00100000:3.0:1789607377.641738:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987456 00000100:00100000:3.0:1789607377.641797:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607377.641806:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149987456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607377.641829:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607377.641935:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149987456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607377.641943:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789607377.642334:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0b800 x1876539149987456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607377.642354:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149987456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789607378.146039:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607379.171702:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607379.683571:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149987840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607379.683637:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607379.683716:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607379.683723:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149987712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607379.683755:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607379.683785:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987840 00000100:00100000:2.0:1789607379.683792:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987840 00000100:00100000:2.0:1789607379.683835:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987712 00000100:00100000:2.0:1789607379.683838:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987712 00000100:00100000:2.0:1789607379.683853:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789607379.683878:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149987840:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607379.687835:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607379.687859:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149987712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607379.687922:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607379.688009:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149987712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607379.688016:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789607379.688069:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d09c00 x1876539149987712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607379.688088:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149987712:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607379.688182:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607379.688218:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149987840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4358us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607379.688234:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789607379.688253:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607379.689592:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e2300 x1876539149987840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607379.689624:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149987840:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789607380.194043:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607380.194099:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607380.194119:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149987968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607380.194185:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607380.194589:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149987968 00000100:00100000:3.0:1789607380.194598:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149987968 00000100:00100000:3.0:1789607380.194653:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607380.194664:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149987968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607380.194906:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607380.194956:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149987968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 295us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607380.194963:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789607380.195044:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149987968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607380.715566:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607380.715588:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149988096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607380.715650:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607380.715714:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988096 00000100:00100000:1.0:1789607380.715721:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988096 00000100:00100000:1.0:1789607380.715768:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607380.715776:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149988096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607380.715810:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607380.715879:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149988096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607380.715887:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607380.715940:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149988096:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1789607380.813031:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:1.0:1789607380.813041:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d78f77e5000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:0.0:1789607380.814273:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e5000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-OST0001 00000020:00000080:0.0:1789607380.814339:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4ba7800 for lustre-OST0001 00010000:00010000:0.0:1789607381.224073:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607381.241459:0:10500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing yml_node 00000100:00100000:2.0:1789607381.512641:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607381.512742:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607381.512775:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607381.512842:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996032 00000100:00100000:0.0:1789607381.512851:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996032 00000100:00100000:0.0:1789607381.512912:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 278 00000100:00100000:0.0:1789607381.512928:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129996032:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607381.512991:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129996032:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 65us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607381.512999:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 278 00000100:00100000:1.0:1789607381.518571:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996160 00000100:00100000:1.0:1789607381.518585:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996160 00000100:00100000:2.0:1789607381.518922:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996288 00000100:00100000:2.0:1789607381.518929:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996288 00000100:00100000:2.0:1789607381.519001:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:2.0:1789607381.519012:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129996288:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607381.519153:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129996288:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 142us (6376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607381.519160:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00080000:2.0:1789607381.519182:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607381.524096:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:1.0:1789607381.524112:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129996160:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607381.524215:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129996160:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 107us (11582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607381.524234:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00080000:2.0:1789607381.524696:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789607382.245444:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607382.756182:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149988224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607382.756249:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756303:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149988736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756347:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756370:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149989248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756395:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756413:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149989760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756431:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756458:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789607382.756464:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149988352:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756504:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756525:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149988864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756548:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756566:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149989376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756585:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756602:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149989888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756618:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756646:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149988480:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756668:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756698:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149988992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756739:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756757:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149989504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756775:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756793:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789607382.756799:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149988608:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756818:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756833:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149989120:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756850:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756881:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149989632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.756901:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607382.756931:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988224 00000100:00100000:1.0:1789607382.756939:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988224 00000100:00100000:1.0:1789607382.756986:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789607382.756994:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149988224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607382.757029:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607382.757071:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149988224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757077:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789607382.757099:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988736 00000100:00100000:1.0:1789607382.757103:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988736 00000100:00100000:1.0:1789607382.757124:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988480 00000100:00100000:1.0:1789607382.757126:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988480 00000100:00100000:1.0:1789607382.757150:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988992 00000100:00100000:1.0:1789607382.757153:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988992 00000100:00100000:1.0:1789607382.757166:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989504 00000100:00100000:1.0:1789607382.757168:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989504 00000100:00100000:1.0:1789607382.757178:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989120 00000100:00100000:1.0:1789607382.757181:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989120 00000100:00100000:1.0:1789607382.757201:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989632 00000100:00100000:1.0:1789607382.757204:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989632 00000100:00100000:1.0:1789607382.757216:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789607382.757222:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149988736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757255:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149988736:12345-0@lo:400:kworker.0 Request processed in 33us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757261:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789607382.757274:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607382.757279:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149988480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757311:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149988480:12345-0@lo:400:kworker.0 Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757317:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607382.757328:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607382.757334:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149988992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757359:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149988992:12345-0@lo:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757364:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607382.757375:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607382.757381:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149989504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757408:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149989504:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757413:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607382.757424:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607382.757431:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149989120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757456:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149989120:12345-0@lo:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757467:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607382.757479:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789607382.757485:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149989632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757513:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149989632:12345-0@lo:400:kworker.0 Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757519:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789607382.757542:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989248 00000100:00100000:1.0:1789607382.757545:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989248 00000100:00100000:1.0:1789607382.757561:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989760 00000100:00100000:1.0:1789607382.757563:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989760 00000100:00100000:1.0:1789607382.757573:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989376 00000100:00100000:1.0:1789607382.757575:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989376 00000100:00100000:1.0:1789607382.757585:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149989888 00000100:00100000:1.0:1789607382.757586:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149989888 00000100:00100000:1.0:1789607382.757596:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607382.757602:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149989248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757631:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149989248:12345-0@lo:400:kworker.0 Request processed in 29us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757637:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607382.757649:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607382.757655:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149989760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757683:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149989760:12345-0@lo:400:kworker.0 Request processed in 28us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757688:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607382.757699:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607382.757704:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149989376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757754:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149989376:12345-0@lo:400:kworker.0 Request processed in 49us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757760:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607382.757772:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607382.757777:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149989888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757802:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149989888:12345-0@lo:400:kworker.0 Request processed in 25us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757807:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607382.757827:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988352 00000100:00100000:1.0:1789607382.757830:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988352 00000100:00100000:1.0:1789607382.757852:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789607382.757858:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149988352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.757909:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149988352:12345-0@lo:400:kworker.0 Request processed in 51us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.757914:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789607382.757938:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988864 00000100:00100000:1.0:1789607382.757942:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988864 00000100:00100000:1.0:1789607382.757960:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149988608 00000100:00100000:1.0:1789607382.757963:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149988608 00000100:00100000:1.0:1789607382.757974:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789607382.757979:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149988864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758009:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149988864:12345-0@lo:400:kworker.0 Request processed in 29us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.758014:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789607382.758025:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789607382.758030:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149988608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758065:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149988608:12345-0@lo:400:kworker.0 Request processed in 35us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607382.758071:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789607382.758105:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607382.758110:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607382.758112:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607382.758114:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607382.758150:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149988608:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758164:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d85880 x1876539149989120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758173:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149989120:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758182:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d84380 x1876539149989632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758190:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149989632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758200:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149988480:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758208:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149988992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758216:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149989504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758251:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149988352:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.758261:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149988864:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758271:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d84700 x1876539149989376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758279:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149989376:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758299:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80700 x1876539149989888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758307:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149989888:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758317:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d86d80 x1876539149988224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758330:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149988224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607382.758340:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149988736:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758349:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d86680 x1876539149989248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758357:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149989248:0@lo:400:kworker.0 00010000:00080000:1.0:1789607382.758366:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d85500 x1876539149989760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607382.758373:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149989760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607382.769096:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607382.769122:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149990016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607382.769199:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607382.775991:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990016 00000100:00100000:2.0:1789607382.776006:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990016 00000100:00100000:2.0:1789607382.776076:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789607382.776087:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149990016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607382.776110:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607382.776189:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149990016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (6989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607382.776196:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789607382.776247:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703100 x1876539149990016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607382.776267:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149990016:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789607383.268079:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607384.290477:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607384.803224:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149990144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607384.803300:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607384.803539:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990144 00000100:00100000:3.0:1789607384.803547:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990144 00000100:00100000:3.0:1789607384.803610:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607384.803620:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149990144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607384.803653:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607384.803724:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149990144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607384.803731:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789607384.803799:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d09500 x1876539149990144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607384.803818:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149990144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607384.803984:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607384.804146:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149990272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607384.804178:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607384.804274:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990272 00000100:00100000:2.0:1789607384.804279:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990272 00000100:00100000:2.0:1789607384.804322:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789607384.804330:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149990272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607384.804342:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607384.804384:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149990272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607384.804390:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789607384.804659:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e2a00 x1876539149990272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607384.804683:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149990272:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789607384.805039:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607385.318415:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607385.318440:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149990400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607385.318518:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607385.318783:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990400 00000100:00100000:3.0:1789607385.318799:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990400 00000100:00100000:3.0:1789607385.318852:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607385.318883:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149990400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607385.318934:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607385.318981:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149990400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607385.318989:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1789607385.319132:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607385.319237:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149990400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607385.827155:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607385.827177:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149990528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607385.827246:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607385.827355:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990528 00000100:00100000:2.0:1789607385.827363:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990528 00000100:00100000:2.0:1789607385.827413:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789607385.827423:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149990528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607385.827460:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607385.827523:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149990528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607385.827530:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607385.827719:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149990528:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607386.338733:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607386.629037:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607386.629539:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996416 00000100:00100000:0.0:1789607386.629548:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996416 00000100:00100000:0.0:1789607386.629595:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 280 00000100:00100000:0.0:1789607386.629604:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129996416:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607386.629677:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129996416:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 69us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607386.629692:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 280 00000100:00100000:3.0:1789607386.633931:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607386.634291:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996544 00000100:00100000:2.0:1789607386.634302:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996544 00000100:00100000:2.0:1789607386.634434:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:2.0:1789607386.634445:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129996544:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607386.634510:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129996544:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 68us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607386.634517:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00080000:1.0:1789607386.634620:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607386.641176:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607386.641263:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996672 00000100:00100000:2.0:1789607386.641282:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996672 00000100:00100000:2.0:1789607386.641406:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:2.0:1789607386.641417:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129996672:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607386.641484:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129996672:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 68us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607386.641491:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00080000:3.0:1789607386.643067:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1789607387.196089:0:10693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789607387.363768:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607387.874108:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149990656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607387.874188:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607387.874313:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990656 00000100:00100000:1.0:1789607387.874321:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990656 00000100:00100000:1.0:1789607387.874385:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789607387.874397:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149990656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607387.874432:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607387.874484:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149990656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607387.874491:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789607387.874532:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52ac000 x1876539149990656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607387.874550:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149990656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607387.874808:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539149990912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.874842:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.874879:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539149991424:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.874909:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.874927:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539149991936:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.874945:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.874963:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789607387.874969:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149990784:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.874992:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875013:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149991296:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875034:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875052:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149991808:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875073:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875101:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990912 00000100:00100000:0.0:1789607387.875105:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990912 00000100:00100000:0.0:1789607387.875134:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991424 00000100:00100000:0.0:1789607387.875136:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991424 00000100:00100000:0.0:1789607387.875150:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991936 00000100:00100000:0.0:1789607387.875152:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991936 00000100:00100000:0.0:1789607387.875166:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789607387.875172:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539149990912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875211:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539149990912:12345-0@lo:400:kworker.0 Request processed in 38us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875216:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789607387.875230:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607387.875237:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539149991424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875262:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539149991424:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875268:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607387.875287:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607387.875292:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539149991936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875320:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539149991936:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875326:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607387.875343:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149990784 00000100:00100000:0.0:1789607387.875346:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149990784 00000100:00100000:0.0:1789607387.875365:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789607387.875371:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149990784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875396:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149990784:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875401:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789607387.875425:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991296 00000100:00100000:0.0:1789607387.875429:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991296 00000100:00100000:0.0:1789607387.875449:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789607387.875454:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149991296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875484:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149991296:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875490:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789607387.875505:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991808 00000100:00100000:0.0:1789607387.875508:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991808 00000100:00100000:0.0:1789607387.875530:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607387.875536:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149991808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875564:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149991808:12345-0@lo:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875569:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607387.875591:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539149991168:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875621:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875637:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149991680:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875656:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875669:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149992192:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875700:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875715:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789607387.875720:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149991040:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875738:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875754:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149991552:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875773:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875786:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149992064:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875803:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607387.875820:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991040 00000100:00100000:0.0:1789607387.875824:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991040 00000100:00100000:0.0:1789607387.875843:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789607387.875849:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149991040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.875911:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149991040:12345-0@lo:400:kworker.0 Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.875917:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789607387.875932:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991168 00000100:00100000:0.0:1789607387.875935:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991168 00000100:00100000:0.0:1789607387.875948:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991552 00000100:00100000:0.0:1789607387.875951:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991552 00000100:00100000:0.0:1789607387.875961:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992064 00000100:00100000:0.0:1789607387.875963:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992064 00000100:00100000:0.0:1789607387.875975:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789607387.875981:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539149991168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876016:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539149991168:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.876022:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789607387.876033:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789607387.876039:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149991552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876060:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149991552:12345-0@lo:400:kworker.0 Request processed in 22us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.876066:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789607387.876075:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789607387.876080:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149992064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876101:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149992064:12345-0@lo:400:kworker.0 Request processed in 21us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607387.876106:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789607387.876136:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149990784:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876148:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149991296:0@lo:400:kworker.0 00010000:00080000:0.0:1789607387.876159:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075ed80 x1876539149991808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607387.876169:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149991808:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876178:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539149990912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876186:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539149991424:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876195:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539149991936:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876228:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149991040:0@lo:400:kworker.0 00010000:00080000:0.0:1789607387.876247:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700000 x1876539149991552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607387.876256:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149991552:0@lo:400:kworker.0 00010000:00080000:0.0:1789607387.876264:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416f800 x1876539149992064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607387.876272:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149992064:0@lo:400:kworker.0 00000100:00100000:0.0:1789607387.876280:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539149991168:0@lo:400:kworker.0 00000100:00080000:3.0:1789607387.876441:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607387.876446:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607387.876448:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607387.876450:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607387.876512:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149991680 00000100:00100000:1.0:1789607387.876517:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149991680 00000100:00100000:1.0:1789607387.876556:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992192 00000100:00100000:1.0:1789607387.876559:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992192 00000100:00100000:1.0:1789607387.876573:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607387.876579:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149991680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607387.876621:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149991680:12345-0@lo:400:kworker.0 Request processed in 43us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607387.876628:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607387.876640:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607387.876646:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149992192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607387.876694:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149992192:12345-0@lo:400:kworker.0 Request processed in 48us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607387.876700:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789607387.876729:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075f100 x1876539149991680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607387.876746:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149991680:0@lo:400:kworker.0 00010000:00080000:1.0:1789607387.876758:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416df80 x1876539149992192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607387.876766:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149992192:0@lo:400:kworker.0 00000100:00080000:3.0:1789607387.876890:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607387.876893:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607387.877825:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149992320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607387.877910:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607387.877950:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992320 00000100:00100000:3.0:1789607387.877958:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992320 00000100:00100000:3.0:1789607387.878004:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607387.878013:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149992320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607387.878034:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607387.878077:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149992320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607387.878096:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789607387.878309:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52ac000 x1876539149992320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607387.878325:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149992320:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789607388.386236:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607389.410176:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607389.893323:0:10790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:2.0:1789607389.922062:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149992448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607389.922130:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607389.922213:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992448 00000100:00100000:2.0:1789607389.922220:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992448 00000100:00100000:2.0:1789607389.922272:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607389.922281:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149992448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607389.922316:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607389.922372:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149992448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607389.922379:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789607389.922399:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789607389.922426:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0e00 x1876539149992448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607389.922456:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149992448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607389.923398:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149992576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607389.923436:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607389.926953:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992576 00000100:00100000:2.0:1789607389.926970:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992576 00000100:00100000:2.0:1789607389.927050:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607389.927060:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149992576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607389.927086:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607389.927184:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149992576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607389.927192:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789607389.927217:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789607389.927249:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0e00 x1876539149992576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607389.927270:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149992576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607390.434500:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607390.434520:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149992704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607390.434597:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607390.434677:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607390.434690:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992704 00000100:00100000:3.0:1789607390.434697:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992704 00000100:00100000:3.0:1789607390.434741:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607390.434751:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149992704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607390.434783:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607390.434829:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149992704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607390.434836:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607390.434904:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149992704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607390.947045:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607390.947079:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149992832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607390.947173:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607390.947268:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992832 00000100:00100000:3.0:1789607390.947278:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992832 00000100:00100000:3.0:1789607390.947338:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607390.947349:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149992832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607390.947403:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607390.947457:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149992832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607390.947465:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607390.947523:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149992832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607391.458302:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607391.748000:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607391.748404:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607391.748443:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607391.748536:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996800 00000100:00100000:1.0:1789607391.748545:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996800 00000100:00100000:1.0:1789607391.748600:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 282 00000100:00100000:1.0:1789607391.748610:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129996800:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607391.748699:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2395:x1876539129996800:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 90us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607391.748706:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 282 00000100:00100000:2.0:1789607391.749513:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997056 00000100:00100000:2.0:1789607391.749522:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997056 00000100:00100000:2.0:1789607391.749583:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129996928 00000100:00100000:2.0:1789607391.749587:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129996928 00000100:00100000:2.0:1789607391.749610:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:2.0:1789607391.749618:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129997056:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607391.749691:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539129997056:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 74us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607391.749698:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:2.0:1789607391.749727:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:2.0:1789607391.749733:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539129996928:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607391.749759:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539129996928:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607391.749765:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00080000:1.0:1789607391.755137:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607391.755147:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789607392.489297:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607392.877398:0:10887:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1789607392.997703:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149993344:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.997770:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998179:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149993856:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998207:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998233:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149994368:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998255:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998285:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789607392.998290:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149992960:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998313:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998336:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149993472:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998358:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998376:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149993984:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998396:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998413:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149994496:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998432:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998457:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149993088:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998477:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998494:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149993600:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998751:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998771:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149994112:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998854:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998896:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789607392.998902:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149993216:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998925:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998944:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149993728:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.998964:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.998973:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149994240:0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999003:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607392.999038:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993344 00000100:00100000:2.0:1789607392.999045:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993344 00000100:00100000:2.0:1789607392.999080:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993088 00000100:00100000:2.0:1789607392.999083:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993088 00000100:00100000:2.0:1789607392.999093:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993600 00000100:00100000:2.0:1789607392.999095:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993600 00000100:00100000:2.0:1789607392.999116:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994112 00000100:00100000:2.0:1789607392.999120:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994112 00000100:00100000:2.0:1789607392.999131:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993728 00000100:00100000:2.0:1789607392.999133:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993728 00000100:00100000:2.0:1789607392.999145:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994240 00000100:00100000:2.0:1789607392.999147:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994240 00000100:00100000:2.0:1789607392.999162:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789607392.999169:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149993344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999220:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539149993344:12345-0@lo:400:kworker.0 Request processed in 50us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607392.999226:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789607392.999242:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789607392.999253:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149993088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999285:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149993088:12345-0@lo:400:kworker.0 Request processed in 33us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607392.999290:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789607392.999302:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789607392.999308:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149993600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999333:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149993600:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607392.999339:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789607392.999350:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607392.999355:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149994112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999383:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149994112:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607392.999388:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607392.999397:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607392.999403:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149993728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999426:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149993728:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607392.999431:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607392.999440:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789607392.999446:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149994240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607392.999470:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149994240:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607392.999475:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789607393.001204:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993856 00000100:00100000:0.0:1789607393.001218:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993856 00000100:00100000:0.0:1789607393.001254:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994368 00000100:00100000:0.0:1789607393.001257:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994368 00000100:00100000:0.0:1789607393.001267:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993984 00000100:00100000:0.0:1789607393.001269:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993984 00000100:00100000:0.0:1789607393.001280:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994496 00000100:00100000:0.0:1789607393.001282:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994496 00000100:00100000:0.0:1789607393.001296:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607393.001304:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149993856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001372:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149993856:12345-0@lo:400:kworker.0 Request processed in 70us (3164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001379:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607393.001391:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789607393.001396:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149994368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001431:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149994368:12345-0@lo:400:kworker.0 Request processed in 35us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001437:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789607393.001446:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789607393.001451:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149993984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001472:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149993984:12345-0@lo:400:kworker.0 Request processed in 21us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001477:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789607393.001485:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607393.001490:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149994496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001523:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149994496:12345-0@lo:400:kworker.0 Request processed in 32us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001528:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607393.001545:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993472 00000100:00100000:0.0:1789607393.001549:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993472 00000100:00100000:0.0:1789607393.001569:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149993216 00000100:00100000:0.0:1789607393.001571:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149993216 00000100:00100000:0.0:1789607393.001592:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789607393.001597:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149993472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001624:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149993472:12345-0@lo:400:kworker.0 Request processed in 27us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001629:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789607393.001651:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789607393.001656:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149993216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001682:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149993216:12345-0@lo:400:kworker.0 Request processed in 26us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001698:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789607393.001717:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149992960 00000100:00100000:0.0:1789607393.001721:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149992960 00000100:00100000:0.0:1789607393.001745:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789607393.001751:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149992960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607393.001782:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149992960:12345-0@lo:400:kworker.0 Request processed in 31us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.001926:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789607393.002007:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607393.002019:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149994624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607393.002048:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607393.002077:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994624 00000100:00100000:0.0:1789607393.002080:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994624 00000100:00100000:0.0:1789607393.002100:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607393.002106:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149994624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607393.002130:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607393.002163:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149994624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.002169:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789607393.002199:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd590a80 x1876539149994624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607393.002216:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149994624:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789607393.006412:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607393.006431:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607393.006435:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607393.006438:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607393.006485:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149992960:0@lo:400:kworker.0 00000100:00100000:2.0:1789607393.006519:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149993472:0@lo:400:kworker.0 00010000:00080000:2.0:1789607393.006536:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6583480 x1876539149993984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607393.006548:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149993984:0@lo:400:kworker.0 00010000:00080000:2.0:1789607393.006562:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6580700 x1876539149994496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607393.006991:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149994496:0@lo:400:kworker.0 00000100:00100000:3.0:1789607393.007154:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149993216:0@lo:400:kworker.0 00010000:00080000:3.0:1789607393.007170:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6582d80 x1876539149993728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607393.007180:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149993728:0@lo:400:kworker.0 00010000:00080000:3.0:1789607393.007194:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6582680 x1876539149994240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607393.007203:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149994240:0@lo:400:kworker.0 00000100:00100000:3.0:1789607393.007215:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149993088:0@lo:400:kworker.0 00000100:00100000:3.0:1789607393.007226:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149993600:0@lo:400:kworker.0 00000100:00100000:3.0:1789607393.007237:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149994112:0@lo:400:kworker.0 00000100:00100000:3.0:1789607393.007508:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607393.007522:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149994752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607393.007591:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607393.007923:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994752 00000100:00100000:0.0:1789607393.007931:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994752 00000100:00100000:0.0:1789607393.007980:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607393.007990:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149994752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607393.008021:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607393.008071:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149994752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607393.008078:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789607393.008118:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416f800 x1876539149994752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607393.008133:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149994752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607393.017470:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539149993344:0@lo:400:kworker.0 00010000:00080000:2.0:1789607393.017490:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6581880 x1876539149993856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607393.021216:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149993856:0@lo:400:kworker.0 00010000:00080000:2.0:1789607393.021260:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6580e00 x1876539149994368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607393.021270:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149994368:0@lo:400:kworker.0 00010000:00010000:3.0:1789607393.506085:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607394.531468:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607394.921163:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 21:09:53 EDT 2026 00000100:00100000:2.0:1789607395.043295:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149994880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607395.043393:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607395.043508:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149994880 00000100:00100000:0.0:1789607395.043516:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149994880 00000100:00100000:0.0:1789607395.043588:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607395.043606:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149994880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607395.043655:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607395.044851:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149994880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1250us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607395.044875:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607395.044941:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149995008:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789607395.045095:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416f800 x1876539149994880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607395.045117:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607395.045278:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149994880:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789607395.045306:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607395.045345:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995008 00000100:00100000:1.0:1789607395.045352:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995008 00000100:00100000:1.0:1789607395.045407:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789607395.045416:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149995008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607395.045436:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789607395.045446:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607395.045486:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149995008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607395.045493:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789607395.045699:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec2a00 x1876539149995008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607395.045714:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149995008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607395.554150:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607395.554184:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149995136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607395.554281:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607395.554351:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995136 00000100:00100000:3.0:1789607395.554362:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995136 00000100:00100000:3.0:1789607395.554435:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789607395.554448:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149995136:12345-0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789607395.554518:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:3.0:1789607395.554786:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607395.554879:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149995136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 413us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607395.554896:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789607395.554946:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149995136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607396.066427:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607396.066459:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149995264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607396.066555:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607396.066768:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995264 00000100:00100000:3.0:1789607396.066780:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995264 00000100:00100000:3.0:1789607396.066832:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607396.066843:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149995264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607396.066912:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607396.066970:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149995264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607396.066977:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607396.067037:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149995264:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789607396.579685:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607396.891849:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607396.892039:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997184 00000100:00100000:0.0:1789607396.892050:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997184 00000100:00100000:0.0:1789607396.892104:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 284 00000100:00100000:0.0:1789607396.892112:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129997184:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607396.892147:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607396.892176:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607396.892194:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997440 00000100:00100000:2.0:1789607396.892198:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997440 00000100:00100000:2.0:1789607396.892235:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997312 00000100:00100000:2.0:1789607396.892238:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997312 00000100:00100000:2.0:1789607396.892258:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:2.0:1789607396.892267:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129997440:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607396.892316:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539129997440:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607396.892324:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:2.0:1789607396.892342:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:2.0:1789607396.892350:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129997312:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607396.892363:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2396:x1876539129997184:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 250us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607396.892373:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 284 00000100:00100000:2.0:1789607396.892380:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539129997312:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607396.892388:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00080000:2.0:1789607396.892412:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607396.892425:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789607397.603148:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607398.124060:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149995392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607398.124141:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.124214:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995392 00000100:00100000:0.0:1789607398.124222:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995392 00000100:00100000:0.0:1789607398.124273:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607398.124282:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149995392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607398.124314:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607398.124351:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149995392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.124357:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789607398.124380:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789607398.124406:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416f800 x1876539149995392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.124422:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149995392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607398.125477:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149995520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125520:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125545:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149996032:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125567:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125585:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149996544:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125620:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125639:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789607398.125645:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149995904:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125667:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125685:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149996416:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125705:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125721:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149996928:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125750:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125778:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149995648:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125799:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125815:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149996160:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125834:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125849:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149996672:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125893:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.125911:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789607398.125917:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149995776:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.125987:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.126006:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149996288:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.126026:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.126036:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149996800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.126052:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.126076:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995520 00000100:00100000:0.0:1789607398.126082:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995520 00000100:00100000:0.0:1789607398.126118:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789607398.126126:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149995520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.126170:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539149995520:12345-0@lo:400:kworker.0 Request processed in 44us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.126177:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789607398.126203:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996032 00000100:00100000:0.0:1789607398.126206:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996032 00000100:00100000:0.0:1789607398.126225:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995776 00000100:00100000:0.0:1789607398.126226:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995776 00000100:00100000:0.0:1789607398.126239:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789607398.126252:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9c78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149996032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.126284:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9c78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149996032:12345-0@lo:400:kworker.0 Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.126289:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789607398.126544:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789607398.126550:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149995776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.126585:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149995776:12345-0@lo:400:kworker.0 Request processed in 34us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.126590:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789607398.131177:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996544 00000100:00100000:0.0:1789607398.131191:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996544 00000100:00100000:0.0:1789607398.131237:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996416 00000100:00100000:0.0:1789607398.131241:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996416 00000100:00100000:0.0:1789607398.131254:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996928 00000100:00100000:0.0:1789607398.131256:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996928 00000100:00100000:0.0:1789607398.131274:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607398.131283:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149996544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131367:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149996544:12345-0@lo:400:kworker.0 Request processed in 85us (5746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131374:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607398.131391:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607398.131397:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149996416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131425:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149996416:12345-0@lo:400:kworker.0 Request processed in 29us (5720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131431:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607398.131441:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607398.131447:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149996928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131496:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149996928:12345-0@lo:400:kworker.0 Request processed in 49us (5745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131502:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607398.131523:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995904 00000100:00100000:0.0:1789607398.131527:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995904 00000100:00100000:0.0:1789607398.131547:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149995648 00000100:00100000:0.0:1789607398.131549:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149995648 00000100:00100000:0.0:1789607398.131560:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996160 00000100:00100000:0.0:1789607398.131562:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996160 00000100:00100000:0.0:1789607398.131574:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996672 00000100:00100000:0.0:1789607398.131577:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996672 00000100:00100000:0.0:1789607398.131589:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996288 00000100:00100000:0.0:1789607398.131591:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996288 00000100:00100000:0.0:1789607398.131614:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149996800 00000100:00100000:0.0:1789607398.131617:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149996800 00000100:00100000:0.0:1789607398.131631:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789607398.131637:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149995904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131669:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539149995904:12345-0@lo:400:kworker.0 Request processed in 32us (6000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131675:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789607398.131687:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607398.131692:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149995648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131721:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539149995648:12345-0@lo:400:kworker.0 Request processed in 29us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131726:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607398.131737:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789607398.131743:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149996160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131769:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539149996160:12345-0@lo:400:kworker.0 Request processed in 27us (5935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131781:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789607398.131793:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789607398.131798:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149996672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131827:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539149996672:12345-0@lo:400:kworker.0 Request processed in 29us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131832:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789607398.131843:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789607398.131848:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149996288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131890:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539149996288:12345-0@lo:400:kworker.0 Request processed in 42us (5863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131895:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789607398.131905:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789607398.131910:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149996800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.131931:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539149996800:12345-0@lo:400:kworker.0 Request processed in 21us (5878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.131936:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789607398.131986:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149997056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607398.132020:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607398.132065:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539149995904:0@lo:400:kworker.0 00010000:00080000:0.0:1789607398.132079:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703100 x1876539149996416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.132088:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149996416:0@lo:400:kworker.0 00010000:00080000:0.0:1789607398.132097:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901374700 x1876539149996928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.132111:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149996928:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.132122:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539149995520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.132132:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149996032:0@lo:400:kworker.0 00010000:00080000:0.0:1789607398.132142:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0701f80 x1876539149996544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.132150:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149996544:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.132208:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149995776:0@lo:400:kworker.0 00010000:00080000:0.0:1789607398.132219:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0701500 x1876539149996288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.132227:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539149996288:0@lo:400:kworker.0 00010000:00080000:0.0:1789607398.132237:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700700 x1876539149996800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.132244:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539149996800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.132254:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539149995648:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.132263:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539149996160:0@lo:400:kworker.0 00000100:00100000:0.0:1789607398.132271:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539149996672:0@lo:400:kworker.0 00000100:00080000:0.0:1789607398.132402:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607398.132407:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607398.132410:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607398.132412:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607398.132433:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997056 00000100:00100000:0.0:1789607398.132437:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997056 00000100:00100000:0.0:1789607398.132462:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607398.132468:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149997056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607398.132487:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607398.132523:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149997056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607398.132529:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789607398.132766:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a56300 x1876539149997056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607398.132779:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149997056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789607398.638043:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607399.650972:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607400.162491:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607400.162680:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149997312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607400.162743:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607400.162769:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997312 00000100:00100000:0.0:1789607400.162776:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997312 00000100:00100000:0.0:1789607400.162834:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607400.162844:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149997312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607400.162906:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607400.162962:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149997312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607400.162969:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789607400.162989:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607400.163148:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec3b80 x1876539149997312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607400.163167:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149997312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607400.163427:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149997184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607400.163457:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607400.166736:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997184 00000100:00100000:1.0:1789607400.166754:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997184 00000100:00100000:1.0:1789607400.166886:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607400.166897:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149997184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607400.166925:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607400.167008:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149997184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (3550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607400.167015:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789607400.167334:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55f80 x1876539149997184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607400.167355:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149997184:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789607400.169149:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607400.674777:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607400.674987:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607400.675010:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149997440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607400.675081:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607400.675149:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997440 00000100:00100000:1.0:1789607400.675156:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997440 00000100:00100000:1.0:1789607400.675203:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607400.675213:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149997440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607400.675264:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607400.675320:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539149997440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607400.675327:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789607400.675403:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539149997440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607401.186489:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607401.186509:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149997568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607401.186606:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607401.186667:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997568 00000100:00100000:1.0:1789607401.186674:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997568 00000100:00100000:1.0:1789607401.186714:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789607401.186736:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149997568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607401.186775:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607401.186818:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539149997568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607401.186825:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789607401.186897:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539149997568:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789607401.698828:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607401.990678:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607401.990714:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607401.990756:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607401.990782:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997696 00000100:00100000:0.0:1789607401.990790:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997696 00000100:00100000:0.0:1789607401.990855:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997824 00000100:00100000:0.0:1789607401.990880:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997824 00000100:00100000:0.0:1789607401.990908:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:0.0:1789607401.990918:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539129997696:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607401.990981:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539129997696:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 65us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607401.990990:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:0.0:1789607401.991006:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:0.0:1789607401.991013:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129997824:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607401.991036:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539129997824:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607401.991042:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00080000:0.0:1789607401.991057:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607401.991060:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607401.991538:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997568 00000100:00100000:2.0:1789607401.991544:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997568 00000100:00100000:2.0:1789607401.991589:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 286 00000100:00100000:2.0:1789607401.991597:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2394:x1876539129997568:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607401.991628:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2394:x1876539129997568:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607401.991635:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 286 00010000:00010000:2.0:1789607402.722839:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607403.235843:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149997696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607403.235973:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607403.236075:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997696 00000100:00100000:2.0:1789607403.236085:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997696 00000100:00100000:2.0:1789607403.236162:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607403.236190:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149997696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607403.236482:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607403.236544:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539149997696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 357us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607403.236553:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789607403.236591:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789607403.236699:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a54000 x1876539149997696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607403.236724:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539149997696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607403.244504:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607403.244533:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149997824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607403.244642:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607403.244720:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997824 00000100:00100000:3.0:1789607403.244730:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997824 00000100:00100000:3.0:1789607403.244801:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789607403.244812:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149997824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607403.244841:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607403.244913:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149997824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607403.244920:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789607403.244946:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607403.244984:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec3100 x1876539149997824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607403.245008:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149997824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607403.245805:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149997952:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.245892:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.245930:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149998464:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.245955:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.245975:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149998976:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.245998:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.246019:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789607403.246024:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149998080:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246049:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.246068:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539149998592:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246088:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.246127:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539149999104:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246149:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.246196:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998464 00000100:00100000:0.0:1789607403.246210:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998464 00000100:00100000:0.0:1789607403.246258:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789607403.246267:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149998464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246336:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149998464:12345-0@lo:400:kworker.0 Request processed in 58us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607403.246343:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789607403.246367:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998976 00000100:00100000:0.0:1789607403.246371:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998976 00000100:00100000:0.0:1789607403.246583:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607403.246602:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149998976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246638:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149998976:12345-0@lo:400:kworker.0 Request processed in 49us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607403.246644:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607403.246665:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998080 00000100:00100000:0.0:1789607403.246668:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998080 00000100:00100000:0.0:1789607403.246694:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998592 00000100:00100000:0.0:1789607403.246697:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998592 00000100:00100000:0.0:1789607403.246710:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999104 00000100:00100000:0.0:1789607403.246712:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999104 00000100:00100000:0.0:1789607403.246731:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789607403.246737:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149998080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246767:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539149998080:12345-0@lo:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607403.246773:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789607403.246786:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789607403.246801:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539149998592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246830:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539149998592:12345-0@lo:400:kworker.0 Request processed in 30us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607403.246836:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789607403.246847:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789607403.246854:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539149999104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246908:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539149999104:12345-0@lo:400:kworker.0 Request processed in 55us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607403.246914:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789607403.246951:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539149998336:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.246977:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.246997:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149998848:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.247018:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.247039:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789607403.247045:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149998208:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.247065:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.247082:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149998720:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.247102:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.247118:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149999232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.247137:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607403.247161:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998848 00000100:00100000:0.0:1789607403.247166:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998848 00000100:00100000:0.0:1789607403.247193:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607403.247200:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149998848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607403.247247:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149998848:12345-0@lo:400:kworker.0 Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607403.247260:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607403.247284:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998336 00000100:00100000:0.0:1789607403.247288:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998336 00000100:00100000:0.0:1789607403.247304:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998720 00000100:00100000:0.0:1789607403.247307:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998720 00000100:00100000:0.0:1789607403.247317:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999232 00000100:00100000:0.0:1789607403.247320:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999232 00000100:00100000:1.0:1789607403.248214:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149997952 00000100:00100000:1.0:1789607403.248226:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149997952 00000100:00100000:1.0:1789607403.248282:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789607403.248292:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248382:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539149997952:12345-0@lo:400:kworker.0 Request processed in 92us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607403.248389:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789607403.248437:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149998208 00000100:00100000:1.0:1789607403.248441:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149998208 00000100:00100000:1.0:1789607403.248468:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789607403.248475:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149998208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248510:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149998208:12345-0@lo:400:kworker.0 Request processed in 35us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607403.248515:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789607403.248584:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607403.248601:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539149998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248647:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539149998336:12345-0@lo:400:kworker.0 Request processed in 56us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607403.248653:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607403.248670:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789607403.248677:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149998720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248704:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539149998720:12345-0@lo:400:kworker.0 Request processed in 29us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607403.248709:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789607403.248757:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539149998080:0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248771:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539149998592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248782:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539149999104:0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248792:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539149997952:0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248804:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149998464:0@lo:400:kworker.0 00010000:00080000:1.0:1789607403.248820:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539149998976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607403.248831:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149998976:0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248931:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149998208:0@lo:400:kworker.0 00010000:00080000:1.0:1789607403.248944:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80e00 x1876539149998720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607403.248953:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539149998720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.248963:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539149998336:0@lo:400:kworker.0 00010000:00080000:1.0:1789607403.248984:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80380 x1876539149998848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607403.248992:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149998848:0@lo:400:kworker.0 00000100:00080000:3.0:1789607403.251071:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607403.251085:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607403.251089:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607403.254808:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789607403.254830:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149999232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607403.254997:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539149999232:12345-0@lo:400:kworker.0 Request processed in 176us (7858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607403.255005:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00080000:1.0:1789607403.255072:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80700 x1876539149999232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607403.255093:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539149999232:0@lo:400:kworker.0 00010000:00010000:2.0:1789607403.746997:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607404.784736:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607405.301078:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607405.301176:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607405.301276:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999360 00000100:00100000:1.0:1789607405.301285:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999360 00000100:00100000:1.0:1789607405.301354:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789607405.301365:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149999360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607405.301410:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607405.301460:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539149999360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607405.301468:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789607405.301492:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607405.301529:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80700 x1876539149999360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607405.301598:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539149999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607405.311223:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607405.311258:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149999488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607405.311353:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607405.313274:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999488 00000100:00100000:2.0:1789607405.313301:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999488 00000100:00100000:2.0:1789607405.313405:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607405.313435:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149999488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607405.313469:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789607405.313578:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607405.313591:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539149999488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607405.313598:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789607405.313656:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a54000 x1876539149999488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607405.313682:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539149999488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607405.795665:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607405.795709:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149999616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607405.795802:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607405.796116:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607405.796134:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999616 00000100:00100000:0.0:1789607405.796143:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999616 00000100:00100000:0.0:1789607405.796213:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789607405.796225:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149999616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607405.796279:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607405.796348:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539149999616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607405.796356:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789607405.796413:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539149999616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607406.311103:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149999744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607406.311200:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607406.311311:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999744 00000100:00100000:2.0:1789607406.311321:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999744 00000100:00100000:2.0:1789607406.311388:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607406.311400:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149999744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607406.311452:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607406.311511:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539149999744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607406.311527:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607406.311599:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539149999744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607406.818362:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607407.107635:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607407.107697:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607407.107739:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998208 00000100:00100000:1.0:1789607407.107755:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998208 00000100:00100000:1.0:1789607407.107841:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:1.0:1789607407.107854:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539129998208:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607407.108008:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539129998208:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 156us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607407.108017:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00080000:1.0:1789607407.108045:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607407.108417:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129997952 00000100:00100000:3.0:1789607407.108424:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129997952 00000100:00100000:3.0:1789607407.108557:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 288 00000100:00100000:3.0:1789607407.108568:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2393:x1876539129997952:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607407.108617:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2393:x1876539129997952:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 51us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607407.108624:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 288 00000100:00100000:3.0:1789607407.108717:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607407.109091:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998080 00000100:00100000:1.0:1789607407.109097:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998080 00000100:00100000:1.0:1789607407.109155:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:1.0:1789607407.109164:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539129998080:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607407.109210:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539129998080:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 48us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607407.109217:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00080000:2.0:1789607407.109456:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789607407.847060:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607408.355375:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149999872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607408.355448:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607408.357552:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539149999872 00000100:00100000:1.0:1789607408.357563:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539149999872 00000100:00100000:1.0:1789607408.357640:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607408.357650:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149999872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607408.357697:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607408.357775:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539149999872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607408.357782:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607408.359534:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150000000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607408.359593:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607408.359645:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000000 00000100:00100000:1.0:1789607408.359651:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000000 00000100:00100000:1.0:1789607408.359689:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789607408.359697:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150000000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607408.359716:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607408.359752:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150000000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607408.359759:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789607408.359799:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539150000000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607408.359817:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150000000:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789607408.360065:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607408.360823:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150000128:0@lo:400:kworker.0 00000100:00100000:0.0:1789607408.360903:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607408.361192:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000128 00000100:00100000:2.0:1789607408.361199:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000128 00000100:00100000:2.0:1789607408.361239:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789607408.361249:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150000128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.361798:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150000128:12345-0@lo:400:kworker.0 Request processed in 550us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607408.361806:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789607408.361899:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150000128:0@lo:400:kworker.0 00000100:00100000:0.0:1789607408.361915:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607408.361921:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150000512:0@lo:400:kworker.0 00000100:00100000:0.0:1789607408.361950:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607408.362035:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000512 00000100:00100000:2.0:1789607408.362040:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000512 00000100:00100000:2.0:1789607408.362074:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789607408.362080:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150000512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.362117:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150000512:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607408.362123:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789607408.362147:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150000512:0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.362314:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150000640:0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.362341:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607408.362391:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000640 00000100:00100000:0.0:1789607408.362396:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000640 00000100:00100000:0.0:1789607408.362425:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789607408.362431:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150000640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607408.362608:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150000640:12345-0@lo:400:kworker.0 Request processed in 175us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607408.362614:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789607408.363143:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150000640:0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.363157:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607408.363163:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150001024:0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.363189:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365047:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150000256:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365102:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365132:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150000768:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365150:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365163:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150001280:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365179:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365197:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789607408.365202:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150000384:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365223:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365240:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150000896:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365259:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365276:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150001408:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365294:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607408.365321:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000256 00000100:00100000:3.0:1789607408.365330:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000256 00000100:00100000:3.0:1789607408.365366:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000768 00000100:00100000:3.0:1789607408.365368:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000768 00000100:00100000:3.0:1789607408.365390:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001280 00000100:00100000:3.0:1789607408.365392:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001280 00000100:00100000:3.0:1789607408.365403:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000896 00000100:00100000:3.0:1789607408.365406:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000896 00000100:00100000:3.0:1789607408.365415:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001408 00000100:00100000:3.0:1789607408.365417:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001408 00000100:00100000:3.0:1789607408.365430:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789607408.365437:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150000256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365496:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150000256:12345-0@lo:400:kworker.0 Request processed in 58us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607408.365766:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789607408.365787:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789607408.365794:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150000768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365825:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150000768:12345-0@lo:400:kworker.0 Request processed in 33us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607408.365831:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789607408.365843:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789607408.365849:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150001280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365892:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150001280:12345-0@lo:400:kworker.0 Request processed in 44us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607408.365898:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789607408.365909:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607408.365915:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150000896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365940:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150000896:12345-0@lo:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607408.365945:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607408.365956:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789607408.365962:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150001408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.365987:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150001408:12345-0@lo:400:kworker.0 Request processed in 26us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607408.365992:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00080000:3.0:1789607408.366031:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec1500 x1876539150000896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607408.366057:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150000896:0@lo:400:kworker.0 00010000:00080000:3.0:1789607408.366070:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec1c00 x1876539150001408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607408.366078:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150001408:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.366087:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150000256:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.366095:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150000768:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.366103:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150001280:0@lo:400:kworker.0 00010000:00080000:3.0:1789607408.366155:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec1880 x1876539149999872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607408.366170:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539149999872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607408.366191:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150001152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607408.366219:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607408.366646:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150000384 00000100:00100000:2.0:1789607408.366652:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150000384 00000100:00100000:2.0:1789607408.366785:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789607408.366793:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150000384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607408.366842:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150000384:12345-0@lo:400:kworker.0 Request processed in 50us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607408.366848:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789607408.367209:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001024 00000100:00100000:0.0:1789607408.367215:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001024 00000100:00100000:0.0:1789607408.367253:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001152 00000100:00100000:0.0:1789607408.367256:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001152 00000100:00100000:0.0:1789607408.367278:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607408.367284:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150001024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607408.367326:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150001024:12345-0@lo:400:kworker.0 Request processed in 42us (4136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607408.367331:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607408.367343:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607408.367348:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150001152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607408.367372:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150001152:12345-0@lo:400:kworker.0 Request processed in 24us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607408.367376:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789607408.367803:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607408.367808:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607408.367811:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607408.368562:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150000384:0@lo:400:kworker.0 00010000:00080000:3.0:1789607408.368601:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec0000 x1876539150001152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607408.368612:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150001152:0@lo:400:kworker.0 00010000:00080000:3.0:1789607408.368624:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec0700 x1876539150001024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607408.368632:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150001024:0@lo:400:kworker.0 00010000:00010000:3.0:1789607408.867318:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607409.891819:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607410.402278:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607410.402305:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150001536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607410.402397:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607410.402569:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001536 00000100:00100000:0.0:1789607410.402578:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001536 00000100:00100000:0.0:1789607410.402661:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607410.402671:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150001536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607410.402723:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607410.402783:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150001536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607410.402790:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789607410.402855:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607410.403125:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55180 x1876539150001536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607410.403144:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150001536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607410.403962:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607410.403977:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150001664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607410.404025:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607410.404115:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001664 00000100:00100000:2.0:1789607410.404123:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001664 00000100:00100000:2.0:1789607410.404185:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607410.404194:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150001664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607410.404211:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607410.404264:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150001664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607410.404270:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789607410.404529:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6581880 x1876539150001664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607410.404544:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150001664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789607410.404670:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607410.915408:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607410.915821:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150001792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607410.915908:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607410.916043:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001792 00000100:00100000:2.0:1789607410.916052:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001792 00000100:00100000:2.0:1789607410.916097:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789607410.916107:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150001792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607410.916145:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607410.916204:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150001792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607410.916212:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789607410.916369:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150001792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607411.443966:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607411.443987:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150001920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607411.444058:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607411.444231:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150001920 00000100:00100000:2.0:1789607411.444239:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150001920 00000100:00100000:2.0:1789607411.444925:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789607411.444940:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150001920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607411.444984:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607411.445048:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150001920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607411.445055:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607411.445144:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150001920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607411.938629:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607412.216766:0:11565:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:10:11 (1789607411) === 00000100:00100000:1.0:1789607412.232916:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.232961:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.232989:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.233014:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998336 00000100:00100000:1.0:1789607412.233022:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998336 00000100:00100000:1.0:1789607412.233067:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 290 00000100:00100000:1.0:1789607412.233076:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2393:x1876539129998336:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607412.233137:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2393:x1876539129998336:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.233144:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 290 00000100:00100000:1.0:1789607412.233173:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998464 00000100:00100000:1.0:1789607412.233176:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998464 00000100:00100000:1.0:1789607412.233206:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998592 00000100:00100000:1.0:1789607412.233209:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998592 00000100:00100000:1.0:1789607412.233226:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:1.0:1789607412.233231:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539129998464:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607412.233258:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539129998464:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.233263:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:1.0:1789607412.233275:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00100000:1.0:1789607412.233280:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539129998592:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607412.233300:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539129998592:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 20us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.233305:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00080000:1.0:1789607412.233406:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607412.233411:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607412.780975:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.781091:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998720 00000100:00100000:2.0:1789607412.781116:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998720 00000100:00100000:2.0:1789607412.781176:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 291 00000100:00100000:2.0:1789607412.781187:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:8944:x1876539129998720:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789607412.781203:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607412.781221:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbd6ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6687e3 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607412.781250:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbd6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687e3 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607412.781262:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbd6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687e3 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607412.781272:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59c000, rc 0) 00000100:00100000:2.0:1789607412.781332:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8944:x1876539129998720:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 147us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.781338:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 291 00000100:00100000:1.0:1789607412.788194:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.788293:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998848 00000100:00100000:2.0:1789607412.788303:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998848 00000100:00100000:2.0:1789607412.788364:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 292 00000100:00100000:2.0:1789607412.788374:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8944:x1876539129998848:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789607412.788685:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8944:x1876539129998848:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 312us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.788692:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 292 00000100:00100000:3.0:1789607412.797122:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.797474:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129998976 00000100:00100000:1.0:1789607412.797485:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129998976 00000100:00100000:1.0:1789607412.797548:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 293 00000100:00100000:1.0:1789607412.797559:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8944:x1876539129998976:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789607412.797816:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8944:x1876539129998976:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 258us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.797824:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 293 00000100:00100000:1.0:1789607412.810300:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607412.810768:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999104 00000100:00100000:3.0:1789607412.810780:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999104 00000100:00100000:3.0:1789607412.810899:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 294 00000100:00100000:3.0:1789607412.810910:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8948:x1876539129999104:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607412.811210:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8948:x1876539129999104:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 301us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607412.811218:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 294 00000100:00100000:3.0:1789607412.825645:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.825798:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999232 00000100:00100000:2.0:1789607412.825809:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999232 00000100:00100000:2.0:1789607412.825902:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 295 00000100:00100000:2.0:1789607412.825913:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8948:x1876539129999232:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607412.826174:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8948:x1876539129999232:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 262us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.826182:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 295 00000100:00100000:0.0:1789607412.830908:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607412.830993:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999360 00000100:00100000:3.0:1789607412.831003:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999360 00000100:00100000:3.0:1789607412.831060:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 296 00000100:00100000:3.0:1789607412.831070:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8948:x1876539129999360:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607412.831319:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8948:x1876539129999360:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 250us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607412.831328:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 296 00000100:00100000:3.0:1789607412.838057:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.839435:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999488 00000100:00100000:1.0:1789607412.839583:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999488 00000100:00100000:1.0:1789607412.839965:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 297 00000100:00100000:1.0:1789607412.839978:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:8944:x1876539129999488:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607412.840000:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607412.840021:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902052400/0xa26202d240fbd6f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668814 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607412.840063:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902052400/0xa26202d240fbd6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668814 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607412.840076:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902052400/0xa26202d240fbd6f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668814 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607412.840086:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902052400, rc 0) 00000100:00100000:1.0:1789607412.840159:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:8944:x1876539129999488:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 183us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.840181:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 297 00000100:00100000:3.0:1789607412.852088:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.853194:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999616 00000100:00100000:2.0:1789607412.853207:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999616 00000100:00100000:2.0:1789607412.853277:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 298 00000100:00100000:2.0:1789607412.853288:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:8944:x1876539129999616:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789607412.853315:0:6463:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789607412.853338:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789607412.853342:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789607412.853346:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789607412.853349:0:6463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789607412.853361:0:6463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789607412.860269:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:8944:x1876539129999616:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 6971us (8178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.860285:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 298 00000100:00100000:1.0:1789607412.871403:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607412.871654:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999744 00000100:00100000:3.0:1789607412.871664:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999744 00000100:00100000:3.0:1789607412.871732:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 299 00000100:00100000:3.0:1789607412.871751:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:8944:x1876539129999744:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789607412.871768:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607412.871786:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66881b expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607412.871815:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607412.871827:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607412.871836:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f000, rc 0) 00000100:00100000:3.0:1789607412.871925:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8944:x1876539129999744:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 176us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607412.871933:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 299 00000100:00100000:3.0:1789607412.877028:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.883401:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539129999872 00000100:00100000:2.0:1789607412.883422:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539129999872 00000100:00100000:2.0:1789607412.883573:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 300 00000100:00100000:2.0:1789607412.883585:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8944:x1876539129999872:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789607412.883931:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8944:x1876539129999872:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 347us (6912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.883941:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 300 00000100:00100000:0.0:1789607412.886437:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607412.886547:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000000 00000100:00100000:3.0:1789607412.886557:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000000 00000100:00100000:3.0:1789607412.886607:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 301 00000100:00100000:3.0:1789607412.886631:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8944:x1876539130000000:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789607412.886854:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8944:x1876539130000000:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 224us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607412.886885:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 301 00000100:00100000:1.0:1789607412.893641:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.894067:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000128 00000100:00100000:2.0:1789607412.894078:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000128 00000100:00100000:2.0:1789607412.894133:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 302 00000100:00100000:2.0:1789607412.894159:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8952:x1876539130000128:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607412.894477:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8952:x1876539130000128:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 312us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.894485:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 302 00000100:00100000:1.0:1789607412.908300:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.908393:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000256 00000100:00100000:2.0:1789607412.908403:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000256 00000100:00100000:2.0:1789607412.908455:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 303 00000100:00100000:2.0:1789607412.908480:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8952:x1876539130000256:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607412.908761:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:8952:x1876539130000256:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 296us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.908770:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 303 00000100:00100000:0.0:1789607412.912587:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607412.912628:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.912733:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000512 00000100:00100000:1.0:1789607412.912752:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000512 00000100:00100000:1.0:1789607412.912803:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000640 00000100:00100000:1.0:1789607412.912807:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000640 00000100:00100000:3.0:1789607412.913216:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:3.0:1789607412.913230:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539130000512:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607412.913305:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539130000512:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 78us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607412.913313:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:3.0:1789607412.913332:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:3.0:1789607412.913340:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130000640:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607412.913366:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130000640:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607412.913372:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:3.0:1789607412.914579:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607412.915086:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000384 00000100:00100000:0.0:1789607412.915096:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000384 00000100:00100000:0.0:1789607412.915143:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:0.0:1789607412.915151:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876539130000384:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789607412.915182:0:7709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ca3bd199-483e-4cd5-beca-47c622e32e26@192.168.203.25@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1789607412.915229:0:7709:0:(genops.c:1384:class_connect()) connect: client ca3bd199-483e-4cd5-beca-47c622e32e26, cookie 0xa26202d240fbd6ff 00000004:00100000:0.0:1789607412.915263:0:7709:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789607412.917055:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00080000:0.0:1789607412.917263:0:7709:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607412.917344:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2392:x1876539130000384:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 2192us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607412.917355:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:0.0:1789607412.917385:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000896 00000100:00100000:0.0:1789607412.917392:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000896 00000100:00100000:0.0:1789607412.917426:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1789607412.917433:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876539130000896:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789607412.917458:0:7709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ca3bd199-483e-4cd5-beca-47c622e32e26@192.168.203.25@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1789607412.918614:0:7709:0:(genops.c:1384:class_connect()) connect: client ca3bd199-483e-4cd5-beca-47c622e32e26, cookie 0xa26202d240fbd706 00000004:00100000:0.0:1789607412.918656:0:7709:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789607412.918959:0:7709:0:(import.c:65:import_set_state_nolock()) ffff8d78fd166000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607412.919035:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2392:x1876539130000896:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 1600us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607412.919044:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:3.0:1789607412.930183:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.930920:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001024 00000100:00100000:1.0:1789607412.930933:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001024 00000100:00100000:1.0:1789607412.931020:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:1.0:1789607412.931030:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:0:x1876539130001024:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607412.931077:0:6468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607412.931180:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:0:x1876539130001024:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 152us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.931187:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00080000:3.0:1789607412.931424:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607412.939727:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607412.939911:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130000768 00000100:00100000:0.0:1789607412.939920:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130000768 00000100:00100000:0.0:1789607412.940006:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607412.940017:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:0:x1876539130000768:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789607412.940063:0:7709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607412.940149:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:0:x1876539130000768:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 133us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607412.940157:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00080000:3.0:1789607412.940281:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607412.941272:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607412.942076:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001152 00000100:00100000:1.0:1789607412.942087:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001152 00000100:00100000:1.0:1789607412.942137:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607412.942148:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001152:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607412.942180:0:6468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607412.942321:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001152:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 174us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607412.942328:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607412.957451:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607412.957613:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001280 00000100:00100000:0.0:1789607412.957624:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001280 00000100:00100000:0.0:1789607412.957690:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607412.957701:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001280:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789607412.957789:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001280:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 89us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607412.957796:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00010000:00010000:2.0:1789607412.963367:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607412.970794:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607412.970838:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607412.970928:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.971005:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001664 00000100:00100000:2.0:1789607412.971015:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001664 00000100:00100000:2.0:1789607412.971072:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1789607412.971082:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001664:12345-192.168.203.25@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789607412.971156:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001664:12345-192.168.203.25@tcp:900:mount.lustre.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.971163:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1789607412.971324:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001408 00000100:00100000:0.0:1789607412.971329:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001408 00000100:00100000:0.0:1789607412.971355:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001536 00000100:00100000:0.0:1789607412.971357:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001536 00000100:00100000:0.0:1789607412.971376:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:0.0:1789607412.971382:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130001408:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789607412.971423:0:8112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ca3bd199-483e-4cd5-beca-47c622e32e26@192.168.203.25@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1789607412.971453:0:8112:0:(genops.c:1384:class_connect()) connect: client ca3bd199-483e-4cd5-beca-47c622e32e26, cookie 0xa26202d240fbd70d 00002000:00100000:0.0:1789607412.971463:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ca3bd199-483e-4cd5-beca-47c622e32e26/ffff8d77c419d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607412.971484:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607412.971719:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607412.971745:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607412.971968:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2392:x1876539130001408:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 583us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607412.971977:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:0.0:1789607412.971994:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607412.971999:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130001536:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789607412.972018:0:8112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ca3bd199-483e-4cd5-beca-47c622e32e26@192.168.203.25@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1789607412.972037:0:8112:0:(genops.c:1384:class_connect()) connect: client ca3bd199-483e-4cd5-beca-47c622e32e26, cookie 0xa26202d240fbd714 00002000:00100000:0.0:1789607412.972042:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ca3bd199-483e-4cd5-beca-47c622e32e26/ffff8d78fd18f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607412.972056:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607412.972173:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789607412.972189:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d78fd18d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607412.972216:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2392:x1876539130001536:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 215us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607412.972222:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1789607412.975053:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607412.977031:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001792 00000100:00100000:2.0:1789607412.977044:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001792 00000100:00100000:2.0:1789607412.977118:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:2.0:1789607412.977127:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001792:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789607412.977844:0:6471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607412.978001:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+6:8944:x1876539130001792:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 873us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607412.978009:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:2.0:1789607413.474069:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150002048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607413.474137:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607413.474223:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002048 00000100:00100000:3.0:1789607413.474233:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002048 00000100:00100000:3.0:1789607413.474306:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789607413.474315:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d79003fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150002048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607413.474351:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607413.474407:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d79003fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150002048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607413.474415:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789607413.474677:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607413.474731:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52af800 x1876539150002048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607413.474749:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150002048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607413.475701:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150002560:0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.475753:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607413.475796:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002560 00000100:00100000:3.0:1789607413.475802:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002560 00000100:00100000:3.0:1789607413.475840:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789607413.475850:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150002560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.475924:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150002560:12345-0@lo:400:kworker.0 Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607413.475932:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789607413.475972:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150002560:0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.475981:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150003072:0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.476011:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607413.476041:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150003584:0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.476061:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607413.476086:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789607413.476101:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150002176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607413.476165:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003072 00000100:00100000:2.0:1789607413.476247:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003072 00000100:00080000:3.0:1789607413.476294:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607413.476302:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003584 00000100:00100000:2.0:1789607413.476307:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003584 00000100:00100000:3.0:1789607413.476317:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607413.476343:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789607413.476351:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.476354:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150002688:0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.476386:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607413.476403:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150003200:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476410:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150003072:12345-0@lo:400:kworker.0 Request processed in 59us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.476417:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789607413.476430:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607413.476431:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002688 00000100:00100000:2.0:1789607413.476436:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002688 00000100:00100000:3.0:1789607413.476453:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150003712:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476457:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789607413.476466:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150003584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476515:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150003584:12345-0@lo:400:kworker.0 Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.476520:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789607413.476532:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789607413.476538:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150002688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476565:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150002688:12345-0@lo:400:kworker.0 Request processed in 27us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.476570:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1789607413.476595:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607413.476619:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002176 00000100:00100000:2.0:1789607413.476624:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002176 00000100:00100000:2.0:1789607413.476661:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789607413.476669:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150002176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607413.476685:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607413.476694:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150002304:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476723:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150002176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.476731:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607413.476739:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607413.476766:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607413.476774:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150002816:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476793:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150002432:0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.476811:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607413.476833:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607413.476837:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150003328:0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.476881:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607413.476912:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002816 00000100:00100000:0.0:1789607413.476916:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002816 00000100:00100000:0.0:1789607413.476946:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789607413.476954:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150002816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476958:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150002944:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.476990:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607413.477009:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150002816:12345-0@lo:400:kworker.0 Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.477012:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150003456:0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.477023:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607413.477034:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607413.477052:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003200 00000100:00100000:0.0:1789607413.477056:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003200 00000100:00100000:2.0:1789607413.477057:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002432 00000100:00100000:2.0:1789607413.477062:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002432 00000100:00100000:2.0:1789607413.477076:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002944 00000100:00100000:2.0:1789607413.477078:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002944 00000100:00100000:2.0:1789607413.477092:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003456 00000100:00100000:2.0:1789607413.477094:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003456 00000100:00100000:0.0:1789607413.477098:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003328 00000100:00100000:0.0:1789607413.477103:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003328 00000100:00100000:2.0:1789607413.477109:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789607413.477115:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150002432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.477135:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789607413.477145:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150003200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.477153:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150002432:12345-0@lo:400:kworker.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.477160:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607413.477183:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150003200:12345-0@lo:400:kworker.0 Request processed in 41us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607413.477189:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789607413.477202:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607413.477208:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150003328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.477227:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789607413.477238:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150003328:12345-0@lo:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.477243:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.477250:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789607413.477290:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150002944:12345-0@lo:400:kworker.0 Request processed in 50us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.477298:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1789607413.477309:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607413.477314:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607413.477315:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789607413.477324:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150003456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.477353:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150002816:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.477360:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150003456:12345-0@lo:400:kworker.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607413.477371:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00080000:0.0:1789607413.477387:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d86680 x1876539150003328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607413.477398:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150003328:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.477407:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150002432:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.477422:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150002944:0@lo:400:kworker.0 00000100:00100000:2.0:1789607413.477434:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150003456:0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.477435:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150002304 00000100:00100000:0.0:1789607413.477442:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150002304 00000100:00100000:0.0:1789607413.477497:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789607413.477504:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.477545:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150002304:12345-0@lo:400:kworker.0 Request processed in 41us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607413.477552:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789607413.477581:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150002304:0@lo:400:kworker.0 00000100:00100000:3.0:1789607413.484599:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789607413.485500:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d86a00 x1876539150003072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607413.485517:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150003072:0@lo:400:kworker.0 00010000:00080000:3.0:1789607413.485530:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d86d80 x1876539150003584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607413.485539:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150003584:0@lo:400:kworker.0 00010000:00080000:3.0:1789607413.485564:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52aed80 x1876539150002176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607413.485582:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150002176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607413.485595:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150002688:0@lo:400:kworker.0 00010000:00080000:3.0:1789607413.485607:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d85500 x1876539150003200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607413.485615:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150003200:0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.487453:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003712 00000100:00100000:0.0:1789607413.487475:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003712 00000100:00100000:0.0:1789607413.487549:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607413.487559:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150003712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607413.487654:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150003712:12345-0@lo:400:kworker.0 Request processed in 96us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607413.487661:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789607413.488781:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d84700 x1876539150003712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607413.488808:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150003712:0@lo:400:kworker.0 00000001:00100000:2.0:1789607413.519593:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00010000:00010000:2.0:1789607413.987528:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607414.065072:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00010000:00010000:1.0:1789607415.015325:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607415.523046:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607415.523067:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150003840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607415.523132:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607415.523236:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003840 00000100:00100000:3.0:1789607415.523244:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003840 00000100:00100000:3.0:1789607415.523305:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607415.523316:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150003840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607415.523346:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607415.523394:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150003840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607415.523401:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789607415.523441:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a54e00 x1876539150003840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607415.523459:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150003840:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789607415.523679:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607415.524752:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607415.524766:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150003968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607415.524811:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607415.524848:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150003968 00000100:00100000:3.0:1789607415.524854:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150003968 00000100:00100000:3.0:1789607415.524916:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607415.524924:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150003968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607415.524943:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607415.524982:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150003968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607415.524988:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789607415.525005:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607415.525023:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec2d80 x1876539150003968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607415.525044:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150003968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607416.034083:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607416.034103:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150004096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607416.034163:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607416.034215:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607416.034227:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004096 00000100:00100000:3.0:1789607416.034234:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004096 00000100:00100000:3.0:1789607416.034279:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789607416.034287:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150004096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607416.034322:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607416.034367:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150004096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607416.034374:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789607416.034418:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150004096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607416.555576:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607416.555600:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150004224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607416.555675:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607416.555914:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004224 00000100:00100000:0.0:1789607416.555922:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004224 00000100:00100000:0.0:1789607416.555980:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607416.555989:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150004224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607416.556026:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607416.556080:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150004224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607416.556087:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607416.557245:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150004224:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1789607416.613604:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00010000:00010000:2.0:1789607417.058609:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607417.657636:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00010000:00010000:1.0:1789607418.083781:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607418.378855:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607418.378911:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607418.378938:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607418.378962:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607418.378981:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607418.378989:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002176 00000100:00100000:0.0:1789607418.378997:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607418.379008:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002176 00000100:00100000:0.0:1789607418.379019:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607418.379039:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002432 00000100:00100000:0.0:1789607418.379043:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002432 00000100:00100000:3.0:1789607418.379059:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002048 00000100:00100000:0.0:1789607418.379059:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002304 00000100:00100000:3.0:1789607418.379061:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002048 00000100:00100000:0.0:1789607418.379061:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002304 00000100:00100000:0.0:1789607418.379077:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:1.0:1789607418.379117:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130001920 00000100:00100000:1.0:1789607418.379122:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130001920 00000100:00100000:1.0:1789607418.379151:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 305 00000100:00100000:1.0:1789607418.379159:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130001920:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607418.379228:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130001920:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 71us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607418.379236:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 305 00000100:00100000:0.0:1789607418.379310:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130002176:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607418.379327:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00100000:3.0:1789607418.379336:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002432:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607418.379341:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130002176:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 258us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607418.379347:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:3.0:1789607418.379359:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002432:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607418.379361:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:3.0:1789607418.379366:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00100000:0.0:1789607418.379368:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002304:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607418.379378:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:0.0:1789607418.379389:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002304:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00080000:2.0:1789607418.379461:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607418.379466:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607418.379581:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539130002048:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607418.379627:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002688 00000100:00100000:2.0:1789607418.379631:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002688 00000100:00100000:2.0:1789607418.379664:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002560 00000100:00100000:2.0:1789607418.379673:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002560 00000100:00100000:2.0:1789607418.379698:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:2.0:1789607418.379706:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002688:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607418.379738:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002688:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.379744:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:2.0:1789607418.379758:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:2.0:1789607418.379764:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002560:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607418.379788:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130002560:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.379793:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00080000:2.0:1789607418.379807:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607418.379810:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607418.380613:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:3.0:1789607418.381092:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539130002048:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 1358us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607418.381104:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:2.0:1789607418.595700:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150004480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.595766:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.595816:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150004992:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.595838:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.595859:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150005504:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.595909:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.595938:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789607418.595944:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150004352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.595971:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.595993:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150004864:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596016:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596034:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150005376:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596065:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596082:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150005888:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596102:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596128:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150004608:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596149:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596167:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150005120:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596187:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596204:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150005632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596223:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596235:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789607418.596241:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150004736:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596261:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596271:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150005248:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596304:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596322:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150005760:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596341:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607418.596372:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004480 00000100:00100000:2.0:1789607418.596379:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004480 00000100:00100000:2.0:1789607418.596417:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004992 00000100:00100000:2.0:1789607418.596420:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004992 00000100:00100000:2.0:1789607418.596468:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005504 00000100:00100000:2.0:1789607418.596472:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005504 00000100:00100000:2.0:1789607418.596484:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005120 00000100:00100000:2.0:1789607418.596487:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005120 00000100:00100000:2.0:1789607418.596499:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005632 00000100:00100000:2.0:1789607418.596501:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005632 00000100:00100000:2.0:1789607418.596512:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004736 00000100:00100000:2.0:1789607418.596519:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004736 00000100:00100000:2.0:1789607418.596539:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789607418.596547:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150004480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596597:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150004480:12345-0@lo:400:kworker.0 Request processed in 51us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596604:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789607418.596621:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789607418.596627:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150004992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596653:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150004992:12345-0@lo:400:kworker.0 Request processed in 27us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596658:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789607418.596669:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789607418.596674:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150005504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596699:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150005504:12345-0@lo:400:kworker.0 Request processed in 25us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596705:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789607418.596715:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789607418.596722:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596751:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150005120:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596757:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789607418.596768:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789607418.596774:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150005632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596800:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150005632:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596814:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789607418.596826:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789607418.596832:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150004736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596882:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150004736:12345-0@lo:400:kworker.0 Request processed in 51us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596888:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789607418.596911:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004352 00000100:00100000:2.0:1789607418.596915:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004352 00000100:00100000:2.0:1789607418.596936:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789607418.596942:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150004352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.596969:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150004352:12345-0@lo:400:kworker.0 Request processed in 28us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.596975:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789607418.597002:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004864 00000100:00100000:2.0:1789607418.597005:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004864 00000100:00100000:2.0:1789607418.597029:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150004608 00000100:00100000:2.0:1789607418.597032:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150004608 00000100:00100000:2.0:1789607418.597045:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607418.597051:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150004864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597081:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150004864:12345-0@lo:400:kworker.0 Request processed in 30us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.597086:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607418.597098:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607418.597104:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150004608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597131:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150004608:12345-0@lo:400:kworker.0 Request processed in 27us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.597146:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607418.597163:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005376 00000100:00100000:2.0:1789607418.597166:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005376 00000100:00100000:2.0:1789607418.597183:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005888 00000100:00100000:2.0:1789607418.597185:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005888 00000100:00100000:2.0:1789607418.597196:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005248 00000100:00100000:2.0:1789607418.597198:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005248 00000100:00100000:2.0:1789607418.597207:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150005760 00000100:00100000:2.0:1789607418.597210:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150005760 00000100:00100000:2.0:1789607418.597221:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607418.597226:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150005376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597257:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150005376:12345-0@lo:400:kworker.0 Request processed in 31us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.597263:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607418.597273:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607418.597279:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150005888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597305:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150005888:12345-0@lo:400:kworker.0 Request processed in 26us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.597310:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607418.597320:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607418.597326:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150005248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597351:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150005248:12345-0@lo:400:kworker.0 Request processed in 26us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.597357:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607418.597367:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607418.597373:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150005760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597410:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150005760:12345-0@lo:400:kworker.0 Request processed in 37us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607418.597416:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789607418.597460:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607418.597464:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607418.597466:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607418.597469:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607418.597516:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150004736:0@lo:400:kworker.0 00010000:00080000:2.0:1789607418.597531:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efd180 x1876539150005248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607418.597542:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150005248:0@lo:400:kworker.0 00010000:00080000:2.0:1789607418.597552:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900eff100 x1876539150005760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607418.597560:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150005760:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597571:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150004608:0@lo:400:kworker.0 00010000:00080000:2.0:1789607418.597579:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a56300 x1876539150005120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607418.597587:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150005120:0@lo:400:kworker.0 00010000:00080000:2.0:1789607418.597595:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efca80 x1876539150005632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607418.597602:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150005632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597638:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150004352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597648:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150004864:0@lo:400:kworker.0 00010000:00080000:2.0:1789607418.597666:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efdc00 x1876539150005376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607418.597674:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150005376:0@lo:400:kworker.0 00010000:00080000:2.0:1789607418.597684:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efce00 x1876539150005888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607418.597692:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150005888:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597701:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150004480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597711:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150004992:0@lo:400:kworker.0 00000100:00100000:2.0:1789607418.597720:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150005504:0@lo:400:kworker.0 00000100:00100000:0.0:1789607418.600916:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607418.600937:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150006016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607418.601006:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607418.601055:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006016 00000100:00100000:0.0:1789607418.601072:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006016 00000100:00100000:0.0:1789607418.601118:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789607418.601127:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150006016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607418.601163:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607418.601208:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150006016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607418.601214:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789607418.601254:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc4000 x1876539150006016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607418.601273:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150006016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607418.605909:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607418.605932:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150006144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607418.605997:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607418.606046:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006144 00000100:00100000:1.0:1789607418.606053:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006144 00000100:00100000:1.0:1789607418.606096:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607418.606104:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150006144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607418.606124:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607418.606168:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150006144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607418.606175:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1789607418.606207:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d87480 x1876539150006144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607418.606237:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150006144:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789607419.111028:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607419.205939:0:11763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789607420.131066:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607420.642119:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607420.642264:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607420.642284:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150006400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607420.642361:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607420.642441:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006400 00000100:00100000:2.0:1789607420.642448:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006400 00000100:00100000:2.0:1789607420.642497:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789607420.642507:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150006400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607420.642538:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607420.642580:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150006400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607420.642587:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789607420.642606:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789607420.642632:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900effb80 x1876539150006400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607420.642670:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150006400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607420.643473:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150006272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607420.643516:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607420.643614:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006272 00000100:00100000:1.0:1789607420.643622:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006272 00000100:00100000:1.0:1789607420.643712:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607420.643729:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150006272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607420.643749:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607420.643932:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150006272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607420.643940:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789607420.643995:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607420.647113:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900ec2d80 x1876539150006272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607420.647143:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150006272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607421.159791:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607421.159817:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150006528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607421.159914:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607421.159997:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607421.160171:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006528 00000100:00100000:3.0:1789607421.160184:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006528 00000100:00100000:3.0:1789607421.160240:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789607421.160255:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150006528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607421.160297:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607421.160354:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150006528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607421.160362:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789607421.161764:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150006528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607421.671822:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150006656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607421.671904:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607421.671982:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006656 00000100:00100000:1.0:1789607421.671990:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006656 00000100:00100000:1.0:1789607421.672036:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789607421.672045:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150006656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607421.672086:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607421.672142:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150006656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607421.672149:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789607421.672235:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150006656:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789607422.178018:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607423.202278:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607423.495542:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495572:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495595:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495620:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495638:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495654:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495676:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607423.495702:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002944 00000100:00100000:3.0:1789607423.495710:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002944 00000100:00100000:3.0:1789607423.495757:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003200 00000100:00100000:3.0:1789607423.495771:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003200 00000100:00100000:3.0:1789607423.495787:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003072 00000100:00100000:3.0:1789607423.495789:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003072 00000100:00100000:3.0:1789607423.495800:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003328 00000100:00100000:3.0:1789607423.495802:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003328 00000100:00100000:3.0:1789607423.495817:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:3.0:1789607423.496160:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539130002944:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496248:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2393:x1876539130002944:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 423us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496257:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:3.0:1789607423.496348:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:3.0:1789607423.496356:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003200:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496383:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003200:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496389:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:3.0:1789607423.496403:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:3.0:1789607423.496420:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130003072:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496449:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130003072:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 41us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496457:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:3.0:1789607423.496475:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:3.0:1789607423.496482:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003328:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496509:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003328:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496515:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:3.0:1789607423.496551:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003456 00000100:00100000:3.0:1789607423.496555:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003456 00000100:00100000:3.0:1789607423.496590:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003584 00000100:00100000:3.0:1789607423.496593:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003584 00000100:00100000:3.0:1789607423.496622:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607423.496631:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003456:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496661:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003456:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 32us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496668:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607423.496684:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:3.0:1789607423.496691:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003584:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496715:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130003584:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496721:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:3.0:1789607423.496739:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130002816 00000100:00100000:3.0:1789607423.496743:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130002816 00000100:00100000:3.0:1789607423.496774:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 307 00000100:00100000:3.0:1789607423.496780:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130002816:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607423.496805:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130002816:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.496810:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 307 00000100:00080000:3.0:1789607423.497149:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607423.497154:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607423.497157:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607423.497160:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607423.714146:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150006912:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.714216:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.714268:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150007424:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.714288:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.714312:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150007936:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.714333:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.714362:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789607423.714369:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150007040:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.714393:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.716253:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150007552:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716306:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.716334:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150008064:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716354:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.716379:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150008448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607423.716401:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607423.716456:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006912 00000100:00100000:2.0:1789607423.716464:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006912 00000100:00100000:2.0:1789607423.716500:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007424 00000100:00100000:2.0:1789607423.716503:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007424 00000100:00100000:2.0:1789607423.716538:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007936 00000100:00100000:2.0:1789607423.716541:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007936 00000100:00100000:2.0:1789607423.716552:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007552 00000100:00100000:2.0:1789607423.716555:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007552 00000100:00100000:2.0:1789607423.716565:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008064 00000100:00100000:2.0:1789607423.716567:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008064 00000100:00100000:2.0:1789607423.716579:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789607423.716587:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150006912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716640:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150006912:12345-0@lo:400:kworker.0 Request processed in 53us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.716647:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789607423.716664:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789607423.716670:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150007424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716697:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150007424:12345-0@lo:400:kworker.0 Request processed in 28us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.716702:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789607423.716712:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789607423.716718:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716744:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150007936:12345-0@lo:400:kworker.0 Request processed in 27us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.716749:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789607423.716760:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789607423.716765:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150007552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716789:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150007552:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.716794:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789607423.716805:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789607423.716817:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150008064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716843:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150008064:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.716848:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1789607423.716895:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607423.716899:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789607423.716921:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55180 x1876539150007552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607423.716935:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150007552:0@lo:400:kworker.0 00010000:00080000:2.0:1789607423.716945:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a57800 x1876539150008064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607423.716952:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150008064:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716962:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150006912:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716971:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150007424:0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.716979:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150007936:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.717087:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150006784:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.717120:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607423.717148:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150007296:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.717171:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607423.717384:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008448 00000100:00100000:1.0:1789607423.717389:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008448 00000100:00100000:1.0:1789607423.717486:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789607423.717493:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150008448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607423.717521:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607423.717563:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150008448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607423.717570:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789607423.717586:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789607423.717604:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d85880 x1876539150008448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607423.717620:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150008448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607423.717731:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607423.717741:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150008576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607423.717769:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607423.719107:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150007168:0@lo:400:kworker.0 00000100:00100000:1.0:1789607423.719156:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607423.719186:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150007680:0@lo:400:kworker.0 00000100:00100000:1.0:1789607423.719207:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607423.719225:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150008192:0@lo:400:kworker.0 00000100:00100000:1.0:1789607423.719242:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607423.719278:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007680 00000100:00100000:1.0:1789607423.719284:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007680 00000100:00100000:1.0:1789607423.719327:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008192 00000100:00100000:1.0:1789607423.719330:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008192 00000100:00100000:1.0:1789607423.719351:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789607423.719358:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150007680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607423.719494:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150007680:12345-0@lo:400:kworker.0 Request processed in 136us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607423.719501:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789607423.719520:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789607423.719527:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150008192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607423.719553:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150008192:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607423.719559:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1789607423.719582:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607423.719606:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a56680 x1876539150007680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607423.719619:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150007680:0@lo:400:kworker.0 00010000:00080000:1.0:1789607423.719628:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffae680 x1876539150008192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607423.719636:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150008192:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.723844:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150007808:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.723926:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607423.723949:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150008320:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.723970:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607423.724040:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150006784 00000100:00100000:0.0:1789607423.724049:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150006784 00000100:00100000:0.0:1789607423.724092:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789607423.724101:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150006784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.724168:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150006784:12345-0@lo:400:kworker.0 Request processed in 67us (7045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607423.724175:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789607423.724253:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008576 00000100:00100000:2.0:1789607423.724258:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008576 00000100:00100000:2.0:1789607423.724295:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789607423.724302:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150008576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607423.724319:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607423.724358:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150008576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (6588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.724364:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789607423.724381:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789607423.724441:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffaed80 x1876539150008576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607423.724462:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150008576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607423.724488:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007168 00000100:00100000:2.0:1789607423.724491:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007168 00000100:00100000:2.0:1789607423.724519:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789607423.724526:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150007168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607423.724566:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150007168:12345-0@lo:400:kworker.0 Request processed in 40us (5409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607423.724572:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789607423.724600:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150007168:0@lo:400:kworker.0 00000100:00100000:3.0:1789607423.724832:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007040 00000100:00100000:3.0:1789607423.724838:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007040 00000100:00100000:3.0:1789607423.724901:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007296 00000100:00100000:3.0:1789607423.724905:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007296 00000100:00100000:3.0:1789607423.724923:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789607423.724929:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150007040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607423.724972:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150007040:12345-0@lo:400:kworker.0 Request processed in 44us (10578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.724978:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789607423.725003:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789607423.725009:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150007296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607423.725040:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150007296:12345-0@lo:400:kworker.0 Request processed in 30us (7867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607423.725045:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789607423.725095:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150007040:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.725650:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150007808 00000100:00100000:0.0:1789607423.725657:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150007808 00000100:00100000:0.0:1789607423.725700:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008320 00000100:00100000:0.0:1789607423.725703:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008320 00000100:00100000:0.0:1789607423.725723:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789607423.725730:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150007808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.725774:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150007808:12345-0@lo:400:kworker.0 Request processed in 45us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607423.725780:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789607423.725793:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607423.725799:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150008320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.725827:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150008320:12345-0@lo:400:kworker.0 Request processed in 28us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607423.725832:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607423.725894:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150006784:0@lo:400:kworker.0 00000100:00100000:0.0:1789607423.725907:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150007296:0@lo:400:kworker.0 00010000:00080000:0.0:1789607423.725918:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a56300 x1876539150007808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607423.725927:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150007808:0@lo:400:kworker.0 00010000:00080000:0.0:1789607423.725937:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffac700 x1876539150008320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607423.725962:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150008320:0@lo:400:kworker.0 00000100:00080000:3.0:1789607423.726249:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607424.226243:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607425.250367:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607425.762130:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607425.762155:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150008704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607425.762223:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607425.762657:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607425.762669:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150008832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607425.762705:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607425.762732:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008704 00000100:00100000:2.0:1789607425.762742:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008704 00000100:00100000:2.0:1789607425.762907:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008832 00000100:00100000:2.0:1789607425.762912:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008832 00000100:00100000:2.0:1789607425.762931:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789607425.762951:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150008704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607425.762984:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607425.763035:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150008704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607425.763042:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789607425.763059:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789607425.763066:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150008832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607425.763076:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607425.763104:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150008832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607425.763120:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789607425.763157:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f7571500 x1876539150008832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607425.763175:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150008832:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789607425.763201:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52ad500 x1876539150008704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607425.763212:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150008704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607425.765204:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607426.274163:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607426.274186:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150008960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607426.274252:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607426.274311:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150008960 00000100:00100000:3.0:1789607426.274318:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150008960 00000100:00100000:3.0:1789607426.274362:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789607426.274383:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150008960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607426.274431:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607426.274474:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150008960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607426.274481:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789607426.274524:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150008960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789607426.276534:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607426.788738:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607426.788762:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150009088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607426.788839:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607426.788931:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009088 00000100:00100000:1.0:1789607426.788940:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009088 00000100:00100000:1.0:1789607426.788997:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789607426.789006:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150009088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607426.789057:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607426.789611:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150009088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 604us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607426.789632:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789607426.791543:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150009088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789607427.298776:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607428.322346:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607428.612974:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613023:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613044:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613078:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613099:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613119:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613144:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607428.613179:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004352 00000100:00100000:0.0:1789607428.613190:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004352 00000100:00100000:0.0:1789607428.613262:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004480 00000100:00100000:0.0:1789607428.613265:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004480 00000100:00100000:0.0:1789607428.613291:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:0.0:1789607428.613303:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004352:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.613463:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003840 00000100:00100000:3.0:1789607428.613469:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003840 00000100:00100000:3.0:1789607428.613502:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004096 00000100:00100000:3.0:1789607428.613505:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004096 00000100:00100000:3.0:1789607428.613525:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003968 00000100:00100000:3.0:1789607428.613528:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003968 00000100:00100000:3.0:1789607428.613547:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004224 00000100:00100000:3.0:1789607428.613549:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004224 00000100:00100000:3.0:1789607428.613566:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 177 00000100:00100000:3.0:1789607428.613575:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539130003840:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.613660:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539130003840:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 86us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.613669:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 177 00000100:00100000:3.0:1789607428.613690:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 178 00000100:00100000:3.0:1789607428.613699:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004096:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.613729:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004096:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.613736:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 178 00000100:00100000:3.0:1789607428.613748:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:3.0:1789607428.613756:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130003968:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.613785:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130003968:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.613792:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:3.0:1789607428.613808:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00100000:3.0:1789607428.613825:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004224:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.613920:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004224:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 105us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.613928:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00100000:3.0:1789607428.614143:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130003712 00000100:00100000:3.0:1789607428.614150:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130003712 00000100:00100000:3.0:1789607428.614187:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 309 00000100:00100000:3.0:1789607428.614197:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130003712:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.614235:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130003712:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 39us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.614243:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 309 00000100:00080000:3.0:1789607428.614315:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607428.614320:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607428.614322:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607428.614325:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607428.614339:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:3.0:1789607428.614348:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004480:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607428.614395:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004480:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 49us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.614401:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1789607428.614952:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130004352:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 1648us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607428.614962:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:0.0:1789607428.834384:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150009216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607428.834463:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.834813:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009216 00000100:00100000:2.0:1789607428.834821:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009216 00000100:00100000:2.0:1789607428.834902:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607428.834914:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150009216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607428.834951:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789607428.835032:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607428.839404:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150009344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607428.839485:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839533:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150009856:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.839558:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839584:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150010368:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.839607:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839627:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150010880:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.839644:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839671:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789607428.839678:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150009728:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.839701:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839722:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150010240:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.839743:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839761:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150010752:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.839796:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607428.839836:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009856 00000100:00100000:1.0:1789607428.839844:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009856 00000100:00100000:1.0:1789607428.839907:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010240 00000100:00100000:1.0:1789607428.839911:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010240 00000100:00100000:1.0:1789607428.839933:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010752 00000100:00100000:1.0:1789607428.839936:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010752 00000100:00100000:1.0:1789607428.839951:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789607428.839958:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150009856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840025:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150009856:12345-0@lo:400:kworker.0 Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.840033:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789607428.840053:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789607428.840059:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150010240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840087:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150010240:12345-0@lo:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.840093:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789607428.840104:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789607428.840110:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150010752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840136:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150010752:12345-0@lo:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.840142:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789607428.840164:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010368 00000100:00100000:1.0:1789607428.840168:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010368 00000100:00100000:1.0:1789607428.840195:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010880 00000100:00100000:1.0:1789607428.840198:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010880 00000100:00100000:1.0:1789607428.840216:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607428.840222:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150010368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840252:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150010368:12345-0@lo:400:kworker.0 Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.840258:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607428.840271:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607428.840277:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150010880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840304:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150010880:12345-0@lo:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.840317:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607428.840340:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009728 00000100:00100000:1.0:1789607428.840343:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009728 00000100:00100000:1.0:1789607428.840367:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789607428.840384:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150009728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840419:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150009728:12345-0@lo:400:kworker.0 Request processed in 36us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.840425:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1789607428.840457:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607428.840460:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607428.840463:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607428.840488:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150009728:0@lo:400:kworker.0 00010000:00080000:1.0:1789607428.840501:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7d180 x1876539150010240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607428.840511:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150010240:0@lo:400:kworker.0 00010000:00080000:1.0:1789607428.840520:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80380 x1876539150010752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607428.840528:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150010752:0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.840537:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150009856:0@lo:400:kworker.0 00010000:00080000:1.0:1789607428.840545:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7fb80 x1876539150010368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607428.840551:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150010368:0@lo:400:kworker.0 00010000:00080000:1.0:1789607428.840559:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd81c00 x1876539150010880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607428.840574:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150010880:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.841316:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150009216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6401us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607428.841326:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607428.841345:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009344 00000100:00100000:2.0:1789607428.841350:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009344 00000100:00100000:2.0:1789607428.841384:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789607428.841392:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150009344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607428.841410:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607428.841465:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150009344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607428.841490:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1789607428.841598:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52ae300 x1876539150009344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607428.841615:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150009344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607428.842053:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150009472:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.842094:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.842134:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150009984:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.842158:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.842177:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150010496:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.842199:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.842220:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789607428.842226:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150009600:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.842249:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.842266:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150010112:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.842285:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.842300:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150010624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.842383:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607428.842415:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009984 00000100:00100000:2.0:1789607428.842419:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009984 00000100:00100000:2.0:1789607428.842449:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607428.842456:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150009984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.842651:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009472 00000100:00100000:1.0:1789607428.842655:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009472 00000100:00100000:1.0:1789607428.842683:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789607428.842690:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150009472:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789607428.843125:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d86d80 x1876539150009216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607428.843144:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150009216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607428.843556:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150009600 00000100:00100000:0.0:1789607428.843561:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150009600 00000100:00100000:0.0:1789607428.843593:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010112 00000100:00100000:0.0:1789607428.843596:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010112 00000100:00100000:0.0:1789607428.843618:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010624 00000100:00100000:0.0:1789607428.843620:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010624 00000100:00100000:0.0:1789607428.843635:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789607428.843642:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150009600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.844002:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150009472:12345-0@lo:400:kworker.0 Request processed in 1310us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.844012:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789607428.844072:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789607428.844081:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150010112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607428.844111:0:6468:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789607428.844126:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150010112:12345-0@lo:400:kworker.0 Request processed in 46us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607428.844134:0:6468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789607428.844146:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789607428.844177:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789607428.844188:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150010624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607428.844254:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150010624:12345-0@lo:400:kworker.0 Request processed in 69us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607428.844261:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1789607428.844381:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607428.844767:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150009984:12345-0@lo:400:kworker.0 Request processed in 2308us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607428.844775:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607428.844933:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150010112:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.844946:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150010624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.844955:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150009472:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.844984:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150009984:0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.845046:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150010496 00000100:00100000:2.0:1789607428.845052:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150010496 00000100:00100000:2.0:1789607428.845090:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789607428.845097:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150010496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607428.845144:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150010496:12345-0@lo:400:kworker.0 Request processed in 48us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607428.845150:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789607428.845180:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c6580e00 x1876539150010496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607428.845191:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150010496:0@lo:400:kworker.0 00000100:00080000:2.0:1789607428.845207:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607428.845963:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150009600:12345-0@lo:400:kworker.0 Request processed in 2316us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607428.845973:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789607428.846110:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150009600:0@lo:400:kworker.0 00010000:00010000:2.0:1789607429.351574:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607430.371939:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607430.882155:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607430.882226:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607430.882449:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011008 00000100:00100000:1.0:1789607430.882469:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011008 00000100:00100000:1.0:1789607430.882548:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607430.882560:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150011008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607430.882592:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789607430.882662:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607430.883631:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150011136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607430.883682:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607430.883736:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011136 00000100:00100000:3.0:1789607430.883753:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011136 00000100:00100000:3.0:1789607430.883789:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789607430.883796:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150011136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607430.883814:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607430.884113:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150011136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 315us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607430.884120:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789607430.884141:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607430.884168:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f7572d80 x1876539150011136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607430.884186:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150011136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607430.884483:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150011008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1925us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607430.884490:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1789607430.884648:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83800 x1876539150011008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607430.884662:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150011008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607431.395243:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607431.398586:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150011264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607431.398653:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607431.398752:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011264 00000100:00100000:1.0:1789607431.398759:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011264 00000100:00100000:1.0:1789607431.398807:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789607431.398816:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150011264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607431.398855:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607431.406454:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150011264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7630us (7792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607431.406470:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789607431.406612:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150011264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607431.911492:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607431.911524:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150011392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607431.911590:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607431.911816:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011392 00000100:00100000:3.0:1789607431.911824:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011392 00000100:00100000:3.0:1789607431.911890:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789607431.911899:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150011392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607431.911939:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607431.912001:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150011392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607431.912008:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789607431.912044:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150011392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607432.421988:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607433.442634:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607433.737008:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607433.737053:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607433.737119:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005248 00000100:00100000:2.0:1789607433.737142:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005248 00000100:00080000:3.0:1789607433.737220:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607433.737226:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005376 00000100:00100000:2.0:1789607433.737232:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005376 00000100:00100000:2.0:1789607433.737267:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1789607433.737277:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2392:x1876539130005248:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:2.0:1789607433.737306:0:8112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd70d 00000100:00080000:3.0:1789607433.737307:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607433.737318:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607433.737371:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789607433.737493:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607433.737534:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607433.737566:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607433.737591:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607433.737610:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607433.737671:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+2:2392:x1876539130005248:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 394us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.737680:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607433.737687:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1789607433.737707:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1789607433.737716:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2392:x1876539130005376:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:2.0:1789607433.737732:0:8112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd714 00000100:00080000:2.0:1789607433.737740:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d78fd18d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789607433.737751:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004608 00000100:00100000:3.0:1789607433.737756:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004608 00000001:00000004:2.0:1789607433.737768:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789607433.737785:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 311 00000100:00100000:3.0:1789607433.737794:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130004608:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607433.737826:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130004608:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 34us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.737833:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 311 00000100:00100000:3.0:1789607433.737903:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004864 00000100:00100000:3.0:1789607433.737907:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004864 00000100:00100000:3.0:1789607433.737935:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005120 00000100:00100000:3.0:1789607433.737938:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005120 00000100:00100000:3.0:1789607433.737952:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004736 00000100:00100000:3.0:1789607433.737954:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004736 00000100:00100000:3.0:1789607433.737967:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130004992 00000100:00100000:3.0:1789607433.737970:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130004992 00000100:00100000:3.0:1789607433.737986:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 187 00000100:00100000:3.0:1789607433.737994:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130004864:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607433.738015:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+2:2392:x1876539130005376:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 299us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.738027:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130004864:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607433.738028:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:3.0:1789607433.738039:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 187 00010000:00010000:2.0:1789607433.738052:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607433.738057:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:3.0:1789607433.738063:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130005120:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607433.738096:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130005120:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.738102:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:3.0:1789607433.738114:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:3.0:1789607433.738120:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130004736:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607433.738157:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130004736:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.738163:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:3.0:1789607433.738177:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:3.0:1789607433.738185:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130004992:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607433.738206:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130004992:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 23us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.738212:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00080000:3.0:1789607433.738241:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607433.738244:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607433.954775:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150011776:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.954841:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.954907:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150012288:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.954932:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.954948:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150012800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.954968:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.954989:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789607433.954995:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150011904:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.955032:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.955049:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150012416:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.955070:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.955095:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150012928:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.955114:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.955150:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012416 00000100:00100000:0.0:1789607433.955157:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012416 00000100:00100000:0.0:1789607433.955201:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012928 00000100:00100000:0.0:1789607433.955204:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012928 00000100:00100000:0.0:1789607433.955227:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789607433.955236:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150012416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.955286:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150012416:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607433.955293:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789607433.955309:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789607433.955315:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150012928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.955359:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150012928:12345-0@lo:400:kworker.0 Request processed in 45us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607433.955365:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1789607433.955408:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901375f80 x1876539150012416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607433.955420:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150012416:0@lo:400:kworker.0 00010000:00080000:0.0:1789607433.955432:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd593b80 x1876539150012928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607433.955439:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150012928:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955692:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150011520:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955728:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.955763:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150012032:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955785:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.955803:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150012544:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955821:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.955836:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150013056:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955853:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.955904:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789607433.955911:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150011648:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955935:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.955953:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150012160:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.955973:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.955988:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150012672:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956008:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607433.956034:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012288 00000100:00100000:3.0:1789607433.956038:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012288 00000100:00100000:3.0:1789607433.956063:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012800 00000100:00100000:3.0:1789607433.956065:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012800 00000100:00100000:3.0:1789607433.956076:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011904 00000100:00100000:3.0:1789607433.956079:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011904 00000100:00100000:3.0:1789607433.956089:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011648 00000100:00100000:3.0:1789607433.956092:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011648 00000100:00100000:3.0:1789607433.956101:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012160 00000100:00100000:3.0:1789607433.956103:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012160 00000100:00100000:3.0:1789607433.956112:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012672 00000100:00100000:3.0:1789607433.956114:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012672 00000100:00100000:3.0:1789607433.956126:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789607433.956133:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150012288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956175:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150012288:12345-0@lo:400:kworker.0 Request processed in 42us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956181:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789607433.956195:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789607433.956201:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150012800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956228:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150012800:12345-0@lo:400:kworker.0 Request processed in 27us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956243:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789607433.956255:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789607433.956261:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150011904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956290:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150011904:12345-0@lo:400:kworker.0 Request processed in 30us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956295:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789607433.956305:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789607433.956310:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150011648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956352:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150011648:12345-0@lo:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956357:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789607433.956369:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789607433.956374:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150012160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956401:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150012160:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956406:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789607433.956416:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789607433.956423:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150012672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956447:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150012672:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956451:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1789607433.956475:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607433.956479:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607433.956481:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607433.956494:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607433.956514:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011776 00000100:00100000:3.0:1789607433.956518:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011776 00000100:00100000:3.0:1789607433.956543:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012032 00000100:00100000:3.0:1789607433.956545:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012032 00000100:00100000:3.0:1789607433.956556:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789607433.956560:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150011776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956592:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150011776:12345-0@lo:400:kworker.0 Request processed in 31us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956597:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789607433.956608:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789607433.956613:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150012032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956639:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150012032:12345-0@lo:400:kworker.0 Request processed in 26us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956644:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789607433.956669:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150012544 00000100:00100000:3.0:1789607433.956673:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150012544 00000100:00100000:3.0:1789607433.956698:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013056 00000100:00100000:3.0:1789607433.956701:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013056 00000100:00100000:3.0:1789607433.956717:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607433.956723:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150012544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956753:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150012544:12345-0@lo:400:kworker.0 Request processed in 30us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956759:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607433.956768:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607433.956775:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956816:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150013056:12345-0@lo:400:kworker.0 Request processed in 43us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607433.956832:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789607433.956845:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607433.956848:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607433.956894:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150011648:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956907:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150012160:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956915:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150012672:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.956923:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150012032:0@lo:400:kworker.0 00010000:00080000:3.0:1789607433.956934:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901375180 x1876539150012544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607433.956944:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150012544:0@lo:400:kworker.0 00010000:00080000:3.0:1789607433.956953:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd590000 x1876539150013056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607433.956960:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150013056:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.957005:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150011904:0@lo:400:kworker.0 00000100:00100000:3.0:1789607433.957014:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150011776:0@lo:400:kworker.0 00010000:00080000:3.0:1789607433.957023:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0f800 x1876539150012288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607433.957032:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150012288:0@lo:400:kworker.0 00010000:00080000:3.0:1789607433.957042:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901374000 x1876539150012800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607433.957050:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150012800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.957289:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150011520 00000100:00100000:0.0:1789607433.957294:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150011520 00000100:00100000:0.0:1789607433.957328:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789607433.957343:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150011520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.957387:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150011520:12345-0@lo:400:kworker.0 Request processed in 52us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607433.957393:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789607433.957432:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150011520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607433.957887:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607433.957900:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150013312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607433.957933:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.957966:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013312 00000100:00100000:0.0:1789607433.957971:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013312 00000100:00100000:0.0:1789607433.957999:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789607433.958006:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150013312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607433.958034:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607433.958068:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150013312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607433.958074:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1789607433.958101:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd593b80 x1876539150013312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607433.958114:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150013312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607433.958127:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607433.958132:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150013184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607433.958151:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607433.958185:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013184 00000100:00100000:0.0:1789607433.958189:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013184 00000100:00100000:0.0:1789607433.958207:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789607433.958212:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150013184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607433.958223:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607433.958251:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150013184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607433.958257:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1789607433.958281:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaec700 x1876539150013184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607433.958292:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150013184:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789607434.466024:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607435.489963:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607436.002199:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150013440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607436.002265:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607436.002394:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150013568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607436.002422:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607436.002460:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013440 00000100:00100000:3.0:1789607436.002467:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013440 00000100:00100000:3.0:1789607436.002511:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013568 00000100:00100000:3.0:1789607436.002515:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013568 00000100:00100000:3.0:1789607436.002533:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607436.002542:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150013440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607436.002575:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607436.002630:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150013440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607436.002636:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607436.002652:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789607436.002658:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150013568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607436.002668:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607436.002696:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150013568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607436.002702:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789607436.002717:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607436.002760:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e3b80 x1876539150013568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607436.002777:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150013568:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789607436.002803:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0e00 x1876539150013440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607436.002824:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150013440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607436.514630:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607436.514652:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150013696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607436.514717:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607436.514776:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013696 00000100:00100000:2.0:1789607436.514784:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013696 00000100:00100000:2.0:1789607436.514823:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789607436.514831:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150013696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607436.514901:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00010000:00010000:1.0:1789607436.515189:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607436.517627:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150013696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2788us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607436.517641:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789607436.529062:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150013696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607437.026355:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607437.026379:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150013824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607437.026447:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607437.026610:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013824 00000100:00100000:1.0:1789607437.026619:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013824 00000100:00100000:1.0:1789607437.026670:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789607437.026679:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150013824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607437.026716:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607437.026774:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150013824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607437.026782:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607437.026842:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150013824:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1789607437.064453:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00000020:00000080:1.0:1789607437.064464:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d78fd18f000/ca3bd199-483e-4cd5-beca-47c622e32e26 00000020:00000080:3.0:1789607437.064590:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd18f000/ca3bd199-483e-4cd5-beca-47c622e32e26 for lustre-OST0001 00000020:00000080:3.0:1789607437.064749:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fd18d000 for lustre-OST0001 00010000:00010000:1.0:1789607437.538379:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607437.769067:0:12618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789607438.097588:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00000020:00000080:2.0:1789607438.097596:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d77c419d800/ca3bd199-483e-4cd5-beca-47c622e32e26 00000020:00000080:1.0:1789607438.097646:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419d800/ca3bd199-483e-4cd5-beca-47c622e32e26 for lustre-OST0000 00000020:00000080:1.0:1789607438.097762:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fd189000 for lustre-OST0000 00010000:00010000:3.0:1789607438.561947:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607438.855666:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607438.855710:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607438.855717:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005504 00000100:00100000:0.0:1789607438.855727:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005504 00000100:00100000:3.0:1789607438.855748:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607438.855780:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 313 00000100:00100000:3.0:1789607438.855786:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607438.855796:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130005504:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607438.855816:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607438.855839:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005632 00000100:00100000:3.0:1789607438.855844:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005632 00000100:00100000:0.0:1789607438.855890:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130005504:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607438.855899:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 313 00000100:00100000:3.0:1789607438.855916:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005760 00000100:00100000:3.0:1789607438.855921:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005760 00000100:00100000:3.0:1789607438.855938:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130005888 00000100:00100000:3.0:1789607438.855940:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130005888 00000100:00100000:3.0:1789607438.855967:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006016 00000100:00100000:3.0:1789607438.855971:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006016 00000100:00100000:3.0:1789607438.855987:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:3.0:1789607438.855993:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130005632:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607438.856027:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130005632:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607438.856033:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:3.0:1789607438.856047:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 198 00000100:00100000:3.0:1789607438.856053:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130005760:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607438.856126:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00100000:1.0:1789607438.856137:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130005888:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607438.856149:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 200 00000100:00100000:2.0:1789607438.856161:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130006016:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607438.856190:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130005888:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607438.856197:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00100000:2.0:1789607438.856210:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130006016:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607438.856219:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 200 00000100:00100000:3.0:1789607438.856637:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130005760:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 583us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607438.856644:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 198 00000100:00080000:3.0:1789607438.856730:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607438.856735:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607439.075887:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150013952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607439.075970:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076026:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150014464:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076052:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076071:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150014976:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076093:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076111:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150015488:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076129:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076149:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789607439.076154:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150014336:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076173:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076188:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150014848:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076203:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076216:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150015360:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076231:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076255:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150014080:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076305:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076329:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150014592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076348:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076361:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150015104:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076376:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076389:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150015616:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076404:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076418:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789607439.076423:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150014208:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076441:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076454:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150014720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076470:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.076485:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150015232:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.076517:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.086127:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150013952 00000100:00100000:1.0:1789607439.086144:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150013952 00000100:00100000:1.0:1789607439.086228:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789607439.086240:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150013952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607439.086277:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607439.086371:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150013952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (10401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.086378:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789607439.086412:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014464 00000100:00100000:1.0:1789607439.086416:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014464 00000100:00100000:1.0:1789607439.086437:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014848 00000100:00100000:1.0:1789607439.087327:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014848 00000100:00100000:1.0:1789607439.087372:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150015360 00000100:00100000:1.0:1789607439.087375:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150015360 00000100:00100000:1.0:1789607439.087388:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014208 00000100:00100000:1.0:1789607439.087390:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014208 00000100:00100000:1.0:1789607439.087400:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014720 00000100:00100000:1.0:1789607439.087403:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014720 00000100:00100000:1.0:1789607439.087416:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150015232 00000100:00100000:1.0:1789607439.087419:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150015232 00000100:00100000:1.0:1789607439.087437:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789607439.087583:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150014464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.087643:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150014464:12345-0@lo:400:kworker.0 Request processed in 64us (11589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.087650:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789607439.087666:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789607439.087671:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150014848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.087699:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150014848:12345-0@lo:400:kworker.0 Request processed in 28us (11495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.087705:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789607439.087715:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789607439.087721:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150015360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.087746:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150015360:12345-0@lo:400:kworker.0 Request processed in 26us (11514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.087751:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789607439.087833:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789607439.087841:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150014208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.087891:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150014208:12345-0@lo:400:kworker.0 Request processed in 52us (11449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.087908:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789607439.087921:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789607439.087926:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150014720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088002:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150014720:12345-0@lo:400:kworker.0 Request processed in 75us (11531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088008:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789607439.088021:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789607439.088027:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150015232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088052:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150015232:12345-0@lo:400:kworker.0 Request processed in 27us (11536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088058:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789607439.088083:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014976 00000100:00100000:1.0:1789607439.088087:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014976 00000100:00100000:1.0:1789607439.088107:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150015488 00000100:00100000:1.0:1789607439.088109:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150015488 00000100:00100000:1.0:1789607439.088119:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150015104 00000100:00100000:1.0:1789607439.088121:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150015104 00000100:00100000:1.0:1789607439.088130:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150015616 00000100:00100000:1.0:1789607439.088133:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150015616 00000100:00100000:1.0:1789607439.088145:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607439.088150:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150014976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088179:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150014976:12345-0@lo:400:kworker.0 Request processed in 28us (12085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088185:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607439.088194:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789607439.088200:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150015488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088237:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150015488:12345-0@lo:400:kworker.0 Request processed in 37us (12107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088243:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789607439.088254:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789607439.088259:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088284:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150015104:12345-0@lo:400:kworker.0 Request processed in 25us (11907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088290:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789607439.088311:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607439.088317:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150015616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088343:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150015616:12345-0@lo:400:kworker.0 Request processed in 27us (11939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088348:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607439.088374:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014336 00000100:00100000:1.0:1789607439.088378:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014336 00000100:00100000:1.0:1789607439.088408:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014592 00000100:00100000:1.0:1789607439.088411:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014592 00000100:00100000:1.0:1789607439.088421:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789607439.088427:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150014336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088565:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150014336:12345-0@lo:400:kworker.0 Request processed in 137us (12390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088572:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789607439.088586:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789607439.088591:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150014592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088620:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150014592:12345-0@lo:400:kworker.0 Request processed in 29us (12271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088635:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789607439.088664:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150014080 00000100:00100000:1.0:1789607439.088668:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150014080 00000100:00100000:1.0:1789607439.088692:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789607439.088698:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150014080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.088729:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150014080:12345-0@lo:400:kworker.0 Request processed in 31us (12434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.088735:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789607439.088896:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150015744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607439.089002:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607439.089071:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150014208:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.089084:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150014720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.089093:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150015232:0@lo:400:kworker.0 00000100:00100000:1.0:1789607439.089102:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150014080:0@lo:400:kworker.0 00000100:00100000:0.0:1789607439.089115:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150015744 00000100:00100000:1.0:1789607439.089117:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150014592:0@lo:400:kworker.0 00000100:00100000:0.0:1789607439.089122:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150015744 00010000:00080000:1.0:1789607439.089135:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaed180 x1876539150015104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089146:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150015104:0@lo:400:kworker.0 00000100:00100000:0.0:1789607439.089160:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1789607439.089161:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaef100 x1876539150015616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089171:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150015616:0@lo:400:kworker.0 00000100:00100000:0.0:1789607439.089181:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150015744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607439.089212:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607439.089220:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150014336:0@lo:400:kworker.0 00010000:00080000:1.0:1789607439.089245:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaeed80 x1876539150014848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089255:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150014848:0@lo:400:kworker.0 00010000:00080000:1.0:1789607439.089269:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaefb80 x1876539150015360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607439.089274:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150015744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607439.089290:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150015360:0@lo:400:kworker.0 00000100:00100000:0.0:1789607439.089290:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1789607439.089645:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaef480 x1876539150013952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089660:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150013952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607439.089670:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150014464:0@lo:400:kworker.0 00010000:00080000:1.0:1789607439.089680:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaeea00 x1876539150014976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089687:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150014976:0@lo:400:kworker.0 00010000:00080000:1.0:1789607439.089695:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaeca80 x1876539150015488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089702:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150015488:0@lo:400:kworker.0 00010000:00080000:1.0:1789607439.089739:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffac700 x1876539150015744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607439.089749:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150015744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789607439.090769:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607439.090777:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607439.090781:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607439.090783:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789607439.591025:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607440.611049:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607441.003482:0:12767:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1d7d1190 20000000:00000080:1.0:1789607441.003505:0:12767:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d77c661c400 uarg=0000000000000000 20000000:01000000:1.0:1789607441.003974:0:12767:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789607441.003980:0:12767:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789607441.003984:0:12767:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789607441.004841:0:12768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789607441.005122:0:12767:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789607441.011529:0:12767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789607441.011633:0:12767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011655:0:12767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 12 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011664:0:12767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011671:0:12767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011693:0:12767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011699:0:12767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011707:0:12767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011714:0:12767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011757:0:12767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.011774:0:12767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 12 pid: 6462 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607441.011787:0:12767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150015872:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607441.012088:0:12767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012097:0:12767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 23 pid: 6463 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607441.012107:0:12767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016000:0@lo:104: 00000100:00100000:2.0:1789607441.012153:0:12767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607441.012200:0:12767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012215:0:12767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 23 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607441.012225:0:12767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016128:0@lo:104: 00000100:00100000:2.0:1789607441.012246:0:12767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607441.012279:0:12767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012298:0:12767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 23 pid: 6464 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607441.012306:0:12767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016256:0@lo:104: 00000100:00100000:2.0:1789607441.012326:0:12767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607441.012335:0:6452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016000 00000100:00100000:3.0:1789607441.012343:0:6452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016000 00000100:00100000:2.0:1789607441.012350:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016128 00000100:00100000:2.0:1789607441.012353:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016128 00000100:00100000:2.0:1789607441.012379:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016256 00000100:00100000:2.0:1789607441.012381:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016256 00000100:00100000:3.0:1789607441.012385:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607441.012393:0:6452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:12767:x1876539150016000:12345-0@lo:104: 00010000:00010000:3.0:1789607441.012405:0:6452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.012455:0:6452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607441.012472:0:6452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c0415db0-4674-4bfe-9696-a490439e72d4+5:12767:x1876539150016000:12345-0@lo:104: Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607441.012693:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607441.012701:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:12767:x1876539150016128:12345-0@lo:104: 00010000:00010000:2.0:1789607441.012710:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012746:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607441.012751:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:12767:x1876539150016128:12345-0@lo:104: Request processed in 53us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607441.012758:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607441.012773:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607441.012779:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:12767:x1876539150016256:12345-0@lo:104: 00010000:00010000:2.0:1789607441.012792:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012825:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789607441.012830:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:12767:x1876539150016256:12345-0@lo:104: Request processed in 52us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607441.012837:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789607441.012854:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607441.012882:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012890:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59ca00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607441.012894:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012903:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607441.012911:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607441.012917:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607441.012944:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012950:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607441.012968:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.012975:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd6dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6e3 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607441.014050:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1789607441.014080:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607441.014087:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014094:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607441.014097:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014105:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607441.014112:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607441.014128:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789607441.014156:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014162:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607441.014172:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014180:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbd6ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6d5 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014193:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607441.014197:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014202:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607441.014205:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014211:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607441.014217:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607441.014222:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789607441.014235:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014241:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607441.014278:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.014294:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571e200/0xa26202d240fbd6c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6c7 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.014297:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607441.014299:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607441.014301:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607441.014302:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607441.014303:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607441.014305:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607441.014346:0:12767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.014358:0:12767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 23 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607441.014370:0:12767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016768:0@lo:104: 00000100:00100000:2.0:1789607441.014413:0:12767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607441.014754:0:12767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 12 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607441.014764:0:12767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 12 pid: 6463 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607441.014773:0:12767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016896:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607441.014814:0:12767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607441.014837:0:12767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016000:0@lo:104: 00000100:00100000:2.0:1789607441.014846:0:12767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016128:0@lo:104: 00000100:00100000:2.0:1789607441.014853:0:12767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016256:0@lo:104: 00000100:00100000:3.0:1789607441.015103:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016768 00000100:00100000:3.0:1789607441.015110:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016768 00000100:00100000:3.0:1789607441.015146:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607441.015153:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:12767:x1876539150016768:12345-0@lo:104: 00010000:00010000:3.0:1789607441.015163:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.015211:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607441.015217:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:12767:x1876539150016768:12345-0@lo:104: Request processed in 65us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607441.015224:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789607441.015239:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607441.015243:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.015249:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59de00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607441.015252:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.015265:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607441.015294:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607441.015300:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789607441.015319:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.015325:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607441.015335:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.015342:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59de00/0xa26202d240fbd6b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd6b9 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.015356:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607441.015358:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607441.015360:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607441.016312:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607441.016331:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150016384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607441.016379:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607441.016426:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607441.016433:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150016512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607441.016454:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607441.016712:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150017024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607441.016737:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607441.016755:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607441.016761:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150016640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607441.016782:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607441.017054:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016384 00000100:00100000:1.0:1789607441.017061:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016384 00010000:00010000:1.0:1789607441.017092:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 24 pid: 6463 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607441.017111:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016512 00000100:00100000:1.0:1789607441.017114:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016512 00010000:00010000:1.0:1789607441.017127:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 25 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607441.017138:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017024 00000100:00100000:1.0:1789607441.017141:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017024 00010000:00010000:1.0:1789607441.017151:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 26 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607441.017176:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150016640 00000100:00100000:1.0:1789607441.017179:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150016640 00010000:00010000:1.0:1789607441.017191:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 27 pid: 6464 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607441.017204:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607441.017211:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+27:3470:x1876539150016384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607441.017236:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607441.017242:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 27 pid: 6463 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017251:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 27 pid: 6463 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017266:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59c200/0xa26202d240fbd6e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd6dc expref: 27 pid: 6463 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017291:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607441.017328:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+26:3470:x1876539150016384:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607441.017335:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607441.017351:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607441.017357:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+25:3470:x1876539150016512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607441.017364:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607441.017369:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 25 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017377:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 25 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017394:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59da00/0xa26202d240fbd6d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd6ce expref: 25 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017402:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607441.017423:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150016512:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607441.017429:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607441.017441:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607441.017446:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+23:3469:x1876539150017024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607441.017453:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789607441.017619:0:12767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016768:0@lo:104: 00010000:00010000:1.0:1789607441.017636:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 23 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017647:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 23 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017657:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbd6b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd6b2 expref: 23 pid: 6462 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017665:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607441.017700:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+22:3469:x1876539150017024:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607441.017706:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607441.017720:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607441.017727:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+21:3469:x1876539150016640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607441.017734:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789607441.017735:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150017024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607441.017738:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 21 pid: 6464 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017751:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 21 pid: 6464 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017760:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e600/0xa26202d240fbd6c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd6c0 expref: 21 pid: 6464 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.017768:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607441.017805:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+20:3469:x1876539150016640:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607441.017811:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789607441.017837:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150016640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607441.017837:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150016512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607441.017845:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150016384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607441.018444:0:12767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150015872:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607441.018456:0:12767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12767:1876539150016896:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607441.018496:0:12767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607441.019689:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607441.020087:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006144 00000100:00100000:1.0:1789607441.020096:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006144 00010000:00010000:1.0:1789607441.020132:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 13 pid: 6462 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607441.020159:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1789607441.020168:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130006144:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607441.020182:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607441.020188:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 13 pid: 6462 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.020198:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 13 pid: 6462 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.020214:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571f000/0xa26202d240fbd6f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66881b expref: 13 pid: 6462 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607441.020242:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607441.020373:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607441.020453:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006272 00000100:00100000:0.0:1789607441.020458:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006272 00010000:00010000:0.0:1789607441.020477:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 13 pid: 6463 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607441.020503:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:0.0:1789607441.020510:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130006272:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607441.020517:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607441.020523:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 13 pid: 6463 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020531:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 13 pid: 6463 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020541:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d400/0xa26202d240fbd6ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687dc expref: 13 pid: 6463 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607441.020737:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:2395:x1876539130006144:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 568us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607441.020746:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00010000:00010000:0.0:1789607441.020927:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020938:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020965:0:6455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020973:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020980:0:6455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020986:0:6455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.020992:0:6455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607441.020996:0:6455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.021004:0:6455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.021023:0:6455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607441.021033:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607441.021063:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:2395:x1876539130006272:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 554us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607441.021070:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00010000:00010000:3.0:1789607441.021420:0:12767:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.021429:0:12767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607441.021441:0:12767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59c400/0xa26202d240fbd71b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607441.124082:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150017280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607441.124152:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607441.124209:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607441.124215:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150017152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607441.124253:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607441.124295:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017280 00000100:00100000:3.0:1789607441.124303:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017280 00000100:00100000:3.0:1789607441.124362:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017152 00000100:00100000:3.0:1789607441.124367:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017152 00000100:00100000:3.0:1789607441.124384:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607441.124392:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150017280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607441.124429:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607441.124478:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150017280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607441.124485:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607441.124501:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789607441.124506:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150017152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607441.124515:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607441.124535:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150017152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607441.124541:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1789607441.124555:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607441.124582:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0e00 x1876539150017152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607441.124600:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150017152:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789607441.124609:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e3b80 x1876539150017280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607441.124619:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150017280:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789607441.634069:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607441.634286:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150017408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607441.634420:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607441.634838:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017408 00000100:00100000:2.0:1789607441.634846:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017408 00000100:00100000:2.0:1789607441.634920:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789607441.634930:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150017408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607441.634971:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607441.635031:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150017408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607441.635038:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789607441.635128:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150017408:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1789607442.081958:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607442.081966:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f77e7800 from 7 10000000:01000000:2.0:1789607442.081970:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607442.082018:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.082031:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.082043:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607442.082067:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.083388:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607442.083517:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017536 00000100:00100000:0.0:1789607442.083527:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017536 00000100:00100000:0.0:1789607442.083571:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789607442.083580:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539150017536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607442.083595:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607442.083613:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd722 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.083638:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd722 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.083649:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd722 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.083659:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d200, rc 0) 00000100:00100000:0.0:1789607442.083699:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150017536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607442.083705:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789607442.083771:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607442.083804:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607442.083820:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.083830:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607442.083921:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.083950:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607442.084003:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017664 00000100:00100000:0.0:1789607442.084007:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017664 00000100:00100000:0.0:1789607442.084042:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789607442.084050:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150017664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607442.084290:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150017664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607442.084298:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789607442.085817:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607442.090899:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.090972:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.091051:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607442.091094:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607442.091399:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017792 00000100:00100000:0.0:1789607442.091730:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017792 00000100:00100000:0.0:1789607442.091985:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789607442.092008:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150017792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607442.092386:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150017792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 378us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607442.092393:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789607442.093330:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789607442.101075:0:12787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789607442.105718:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789607442.105751:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607442.105761:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.105774:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607442.105785:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607442.105787:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7901022000 from 7 10000000:01000000:1.0:1789607442.105790:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607442.105825:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.105833:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.105843:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607442.105896:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.105966:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607442.106014:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607442.107578:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150017920 00000100:00100000:3.0:1789607442.107593:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150017920 00000100:00100000:3.0:1789607442.107654:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789607442.107665:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150017920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607442.107682:0:6463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607442.107698:0:6463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd730 expref: -99 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.107723:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd730 expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.107735:0:6463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd730 expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.107743:0:6463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607442.107810:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150017920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.107817:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789607442.107926:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150017920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607442.107956:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.107966:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607442.108032:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.108065:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607442.108090:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607442.108105:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018048 00000100:00100000:1.0:1789607442.108109:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018048 00000100:00100000:1.0:1789607442.108134:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789607442.108140:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150018048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.108450:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150018048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.108457:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789607442.108490:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.108518:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.108555:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607442.108569:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607442.108581:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018176 00000100:00100000:1.0:1789607442.108584:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018176 00000100:00100000:1.0:1789607442.108607:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789607442.108612:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150018176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.108745:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150018176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.108760:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789607442.108795:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789607442.110167:0:12789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789607442.110379:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789607442.110411:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607442.110429:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.110442:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607442.110455:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607442.110458:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f05a9800 from 7 10000000:01000000:2.0:1789607442.110461:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607442.110494:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.110521:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.110534:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607442.110555:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.110608:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607442.110649:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607442.110858:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018304 00000100:00100000:1.0:1789607442.110935:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018304 00000100:00100000:1.0:1789607442.110972:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789607442.110982:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150018304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607442.110995:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607442.111010:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd73e expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.111032:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd73e expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.111043:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd73e expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.111051:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902053c00, rc 0) 00000100:00100000:1.0:1789607442.112220:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150018304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1234us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.112230:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789607442.113429:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607442.113456:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.113468:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607442.113757:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.113799:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607442.113830:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607442.113836:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018432 00000100:00100000:3.0:1789607442.113850:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018432 00000100:00100000:3.0:1789607442.113903:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789607442.113912:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150018432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607442.114285:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150018432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.114293:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789607442.114310:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.114337:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.114371:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607442.114399:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607442.114604:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018560 00000100:00100000:1.0:1789607442.114609:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018560 00000100:00100000:1.0:1789607442.114645:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789607442.114653:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150018560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.114789:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150018560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.114804:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789607442.114893:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789607442.116309:0:12790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789607442.116677:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789607442.116697:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607442.116707:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.116719:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607442.116746:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607442.116749:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c75d7000 from 7 10000000:01000000:2.0:1789607442.116752:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607442.116781:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.116789:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.116800:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607442.116820:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.117044:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607442.117112:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607442.117185:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018688 00000100:00100000:3.0:1789607442.117192:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018688 00000100:00100000:3.0:1789607442.117264:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789607442.117283:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150018688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607442.117297:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607442.117310:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd74c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.117333:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd74c expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.117356:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd74c expref: 24 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607442.117365:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571fc00, rc 0) 00000100:00100000:3.0:1789607442.117598:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150018688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.117606:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789607442.117813:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607442.117829:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607442.117839:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607442.117922:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607442.117952:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607442.117971:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607442.118073:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018816 00000100:00100000:1.0:1789607442.118078:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018816 00000100:00100000:1.0:1789607442.118102:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789607442.118109:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150018816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607442.118356:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150018816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.118364:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789607442.118696:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607442.118731:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607442.118769:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607442.118831:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607442.118952:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150018944 00000100:00100000:3.0:1789607442.118957:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150018944 00000100:00100000:3.0:1789607442.118981:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789607442.118988:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150018944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607442.119146:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150018944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.119153:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789607442.119225:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150018944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789607442.120255:0:12791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789607442.120436:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789607442.120456:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607442.120466:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.120477:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607442.147585:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150019072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607442.147655:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607442.147717:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019072 00000100:00100000:1.0:1789607442.147724:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019072 00000100:00100000:1.0:1789607442.147769:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789607442.147778:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150019072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607442.147816:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607442.148969:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150019072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607442.153506:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150019072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.153533:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789607442.312649:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607442.312830:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006400 00000100:00100000:0.0:1789607442.312840:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006400 00000100:00100000:0.0:1789607442.312937:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 327 00000100:00100000:0.0:1789607442.312949:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:6373:x1876539130006400:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607442.312966:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607442.312984:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66884c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.313013:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.313038:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607442.313047:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075ce00, rc 0) 00000100:00100000:0.0:1789607442.313107:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130006400:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 161us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607442.313114:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 327 00000100:00100000:1.0:1789607442.320160:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607442.321224:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006528 00000100:00100000:3.0:1789607442.321237:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006528 00000100:00100000:3.0:1789607442.321310:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 328 00000100:00100000:3.0:1789607442.321321:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130006528:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607442.323366:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130006528:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 928us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.323379:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 328 00000100:00100000:3.0:1789607442.327958:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607442.328039:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006656 00000100:00100000:0.0:1789607442.328050:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006656 00000100:00100000:0.0:1789607442.328110:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 329 00000100:00100000:0.0:1789607442.328121:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130006656:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607442.328343:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130006656:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 223us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607442.328351:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 329 00000100:00100000:3.0:1789607442.336030:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607442.342389:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006784 00000100:00100000:1.0:1789607442.342403:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006784 00000100:00100000:1.0:1789607442.342489:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 330 00000100:00100000:1.0:1789607442.342498:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130006784:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607442.342513:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607442.342531:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668853 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.342581:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.342591:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607442.342600:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902052c00, rc 0) 00000100:00100000:1.0:1789607442.342660:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130006784:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 162us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607442.342667:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 330 00000100:00100000:1.0:1789607442.351152:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607442.351230:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130006912 00000100:00100000:3.0:1789607442.351240:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130006912 00000100:00100000:3.0:1789607442.351306:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 331 00000100:00100000:3.0:1789607442.351316:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130006912:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607442.351595:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130006912:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 280us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.351603:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 331 00000100:00100000:1.0:1789607442.355928:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607442.355982:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007040 00000100:00100000:3.0:1789607442.355993:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007040 00000100:00100000:3.0:1789607442.356051:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 332 00000100:00100000:3.0:1789607442.356060:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130007040:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607442.356268:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130007040:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 208us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607442.356294:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 332 00010000:00010000:3.0:1789607442.658015:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607443.685564:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607443.977512:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607443.977554:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607443.977577:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607443.977595:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607443.977628:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607443.977655:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007424 00000100:00100000:0.0:1789607443.977664:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007424 00000100:00100000:0.0:1789607443.977720:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007680 00000100:00100000:0.0:1789607443.977722:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007680 00000100:00100000:0.0:1789607443.977735:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007296 00000100:00100000:0.0:1789607443.977738:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007296 00000100:00100000:0.0:1789607443.977748:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007552 00000100:00100000:0.0:1789607443.977750:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007552 00000100:00100000:2.0:1789607443.977883:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007168 00000100:00100000:2.0:1789607443.977887:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007168 00000100:00100000:2.0:1789607443.977919:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 333 00000100:00100000:2.0:1789607443.977928:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130007168:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607443.978008:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130007168:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 81us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607443.978016:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 333 00000100:00100000:0.0:1789607443.978488:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:0.0:1789607443.978500:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130007424:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607443.978553:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130007424:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 57us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607443.978560:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:0.0:1789607443.978574:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 208 00000100:00100000:0.0:1789607443.978581:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130007680:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607443.978602:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130007680:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607443.978608:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 208 00000100:00100000:0.0:1789607443.978617:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:0.0:1789607443.978623:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130007296:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607443.978641:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130007296:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 19us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607443.978647:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:0.0:1789607443.978656:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 210 00000100:00100000:0.0:1789607443.978662:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130007552:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607443.978680:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130007552:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 18us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607443.978685:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 210 00000100:00080000:0.0:1789607443.978712:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607443.978716:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607444.194553:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150019456:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.194634:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607444.194687:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150019968:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.194710:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607444.194734:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150020480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.194754:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607444.194807:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789607444.194814:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150019584:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.194839:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607444.194857:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150020096:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.194912:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607444.194930:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150020608:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.194950:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607444.194985:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019456 00000100:00100000:2.0:1789607444.195005:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019456 00000100:00100000:2.0:1789607444.195045:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019968 00000100:00100000:2.0:1789607444.195048:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019968 00000100:00100000:2.0:1789607444.195072:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020480 00000100:00100000:2.0:1789607444.195083:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020480 00000100:00100000:2.0:1789607444.195101:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020096 00000100:00100000:2.0:1789607444.195104:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020096 00000100:00100000:2.0:1789607444.195118:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020608 00000100:00100000:2.0:1789607444.195121:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020608 00000100:00100000:2.0:1789607444.195139:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789607444.195147:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150019456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195203:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150019456:12345-0@lo:400:kworker.0 Request processed in 56us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607444.195210:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789607444.195228:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789607444.195235:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150019968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195276:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150019968:12345-0@lo:400:kworker.0 Request processed in 42us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607444.195282:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789607444.195295:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789607444.195301:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150020480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195326:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150020480:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607444.195332:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789607444.195343:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789607444.195349:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150020096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195377:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150020096:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607444.195383:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789607444.195394:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789607444.195401:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150020608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195437:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150020608:12345-0@lo:400:kworker.0 Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607444.195443:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:2.0:1789607444.195476:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607444.195480:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789607444.195506:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffae680 x1876539150020096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607444.195520:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150020096:0@lo:400:kworker.0 00010000:00080000:2.0:1789607444.195531:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5f1b480 x1876539150020608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607444.195539:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150020608:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195550:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150019456:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195558:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150019968:0@lo:400:kworker.0 00000100:00100000:2.0:1789607444.195567:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150020480:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.195937:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150019200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607444.195974:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196067:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150019712:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196090:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196112:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150020224:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196135:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196153:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150020736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196174:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196199:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789607444.196207:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150019328:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196438:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196466:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150019840:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196507:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196529:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150020352:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196550:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196567:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150020864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196587:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607444.196616:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020224 00000100:00100000:1.0:1789607444.196622:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020224 00000100:00100000:1.0:1789607444.196657:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020736 00000100:00100000:1.0:1789607444.196659:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020736 00000100:00100000:1.0:1789607444.196670:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020352 00000100:00100000:1.0:1789607444.196671:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020352 00000100:00100000:1.0:1789607444.196684:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020864 00000100:00100000:1.0:1789607444.196686:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020864 00000100:00100000:1.0:1789607444.196699:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789607444.196706:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.196750:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150020224:12345-0@lo:400:kworker.0 Request processed in 45us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.196757:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789607444.196889:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019200 00000100:00100000:2.0:1789607444.196893:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019200 00000100:00100000:2.0:1789607444.196925:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789607444.196932:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150019200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607444.196961:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607444.197077:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150019200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607444.197084:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789607444.197503:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789607444.197512:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150020736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.197551:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150020736:12345-0@lo:400:kworker.0 Request processed in 40us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.197556:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789607444.197570:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789607444.197577:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150020352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.197604:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150020352:12345-0@lo:400:kworker.0 Request processed in 29us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.197621:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789607444.197634:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789607444.197639:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150020864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.197668:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150020864:12345-0@lo:400:kworker.0 Request processed in 29us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.197673:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789607444.197696:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019328 00000100:00100000:1.0:1789607444.197700:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019328 00000100:00100000:1.0:1789607444.197733:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789607444.197739:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150019328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.197765:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150019328:12345-0@lo:400:kworker.0 Request processed in 26us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.198080:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789607444.198121:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019584 00000100:00100000:1.0:1789607444.198125:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019584 00000100:00100000:1.0:1789607444.198147:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019840 00000100:00100000:1.0:1789607444.198149:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019840 00000100:00100000:1.0:1789607444.198162:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789607444.198167:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.198212:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150019584:12345-0@lo:400:kworker.0 Request processed in 45us (3372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.198218:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789607444.198230:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789607444.199433:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150019840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.199507:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150019840:12345-0@lo:400:kworker.0 Request processed in 1270us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607444.199540:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1789607444.199581:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607444.199586:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607444.199618:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150019328:0@lo:400:kworker.0 00000100:00100000:1.0:1789607444.199632:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150019840:0@lo:400:kworker.0 00010000:00080000:1.0:1789607444.199649:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5f1a680 x1876539150020352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607444.199660:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150020352:0@lo:400:kworker.0 00010000:00080000:1.0:1789607444.199672:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5f19500 x1876539150020864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607444.199680:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150020864:0@lo:400:kworker.0 00010000:00080000:1.0:1789607444.199690:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a54e00 x1876539150019200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607444.199705:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150019200:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789607444.199716:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffac700 x1876539150020224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607444.199724:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150020224:0@lo:400:kworker.0 00010000:00080000:1.0:1789607444.199733:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5f18380 x1876539150020736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607444.199740:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150020736:0@lo:400:kworker.0 00000100:00100000:3.0:1789607444.203700:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150019712 00000100:00100000:3.0:1789607444.203713:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150019712 00000100:00100000:3.0:1789607444.203761:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789607444.203849:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150019712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607444.203957:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150019712:12345-0@lo:400:kworker.0 Request processed in 187us (7865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607444.203965:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789607444.204081:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150020992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607444.204120:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607444.204169:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150019584:0@lo:400:kworker.0 00000100:00100000:3.0:1789607444.204199:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150020992 00000100:00100000:3.0:1789607444.204202:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150020992 00000100:00100000:3.0:1789607444.204225:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789607444.204232:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150020992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607444.204248:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607444.204295:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150020992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607444.204301:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789607444.204329:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d08e00 x1876539150020992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607444.204346:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150020992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607444.204761:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150019712:0@lo:400:kworker.0 00010000:00010000:2.0:1789607444.707411:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607445.070534:0:12967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789607445.730255:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607446.242033:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607446.242033:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150021248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607446.242052:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150021120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607446.242100:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607446.242135:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021248 00000100:00100000:3.0:1789607446.242143:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021248 00000100:00100000:0.0:1789607446.242181:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607446.242249:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607446.249254:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021120 00000100:00100000:3.0:1789607446.249273:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021120 00000100:00100000:3.0:1789607446.249352:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607446.249363:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150021248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607446.249402:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607446.249564:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150021248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (7463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607446.249572:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607446.249590:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789607446.249596:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150021120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607446.249607:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607446.249634:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150021120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (7453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607446.249639:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789607446.249663:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607446.251110:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d08e00 x1876539150021120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607446.251137:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150021120:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789607446.251185:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901375f80 x1876539150021248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607446.251197:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150021248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607446.754010:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607446.754181:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150021376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607446.754272:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607446.754380:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021376 00000100:00100000:0.0:1789607446.754388:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021376 00000100:00100000:0.0:1789607446.754436:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789607446.754445:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150021376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607446.754486:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607446.754584:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150021376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607446.754634:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150021376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607446.754680:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789607447.266964:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607447.266989:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150021504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607447.267052:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607447.267181:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021504 00000100:00100000:3.0:1789607447.267189:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021504 00000100:00100000:3.0:1789607447.267264:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789607447.267287:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150021504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607447.267322:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607447.267371:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150021504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607447.267378:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789607447.267812:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150021504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607447.780429:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607448.404696:0:13067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:10:47 (1789607447) === 00000100:00100000:0.0:1789607448.798889:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607448.799339:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607448.800056:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007936 00000100:00100000:1.0:1789607448.800068:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007936 00000100:00100000:1.0:1789607448.800142:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:1.0:1789607448.800153:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:10607:x1876539130007936:12345-192.168.203.25@tcp:700:mkdir.0 00000100:00100000:1.0:1789607448.800247:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:10607:x1876539130007936:12345-192.168.203.25@tcp:700:mkdir.0 Request processed in 96us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607448.800254:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00080000:3.0:1789607448.802186:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789607448.802263:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607448.802935:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130007808 00000100:00100000:2.0:1789607448.802946:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130007808 00000100:00100000:2.0:1789607448.803060:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1789607448.803071:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130007808:12345-192.168.203.25@tcp:41:mkdir.0 00000004:00000024:2.0:1789607448.803123:0:6468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607448.803418:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130007808:12345-192.168.203.25@tcp:41:mkdir.0 Request processed in 348us (4567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607448.803427:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1789607448.811536:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.811634:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130008192 00000100:00100000:2.0:1789607448.811645:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130008192 00000100:00100000:2.0:1789607448.811702:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1789607448.811713:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:10607:x1876539130008192:12345-192.168.203.25@tcp:36:mkdir.0 00010000:00010000:2.0:1789607448.811765:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607448.811813:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd60a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687c7 expref: 6 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.811835:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83200) 00010000:00010000:2.0:1789607448.811846:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607448.812520:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.812536:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.812548:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.812571:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.812579:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.812586:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818694:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818718:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818732:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607448.818748:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000559aa2c0 reply state 00000000195246cb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818760:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818768:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607448.818771:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607448.818775:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789607448.818780:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607448.818789:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818795:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818817:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818823:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607448.818827:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818835:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818845:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607448.818849:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607448.818852:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818858:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd768 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607448.818898:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000559aa2c0 reply state 00000000195246cb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818907:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.818914:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d78c6f8c500) 00010000:00010000:2.0:1789607448.818916:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607448.818918:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789607448.819018:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:10607:x1876539130008192:12345-192.168.203.25@tcp:36:mkdir.0 Request processed in 7303us (7491us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789607448.819027:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1789607448.839134:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.839341:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130008320 00000100:00100000:2.0:1789607448.839352:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130008320 00000100:00100000:2.0:1789607448.839415:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:2.0:1789607448.839425:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:10608:x1876539130008320:12345-192.168.203.25@tcp:101:chmod.0 00010000:00010000:2.0:1789607448.839446:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607448.839470:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd77d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66885a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.839538:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.839552:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.839565:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607448.839601:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607448.839605:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607448.839659:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.839685:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd77d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66885a expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.839703:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66885a expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.839711:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607448.839714:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607448.839732:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59de00, rc 0) 00000100:00100000:2.0:1789607448.839799:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:10608:x1876539130008320:12345-192.168.203.25@tcp:101:chmod.0 Request processed in 375us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607448.839806:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1789607448.843694:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.843770:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130008576 00000100:00100000:2.0:1789607448.843781:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130008576 00000100:00100000:2.0:1789607448.843838:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607448.843848:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:10608:x1876539130008576:12345-192.168.203.25@tcp:36:chmod.0 00010000:00010000:2.0:1789607448.843943:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607448.843969:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66885a expref: 8 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.843987:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607448.843997:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607448.844020:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.844032:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.844042:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607448.844598:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000347e3129 reply state 00000000912684a6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.844613:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.844620:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607448.844629:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789607448.844632:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789607448.844641:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607448.845795:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:10608:x1876539130008576:12345-192.168.203.25@tcp:36:chmod.0 Request processed in 1939us (2100us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789607448.845807:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:3.0:1789607448.869735:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.869842:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130008704 00000100:00100000:2.0:1789607448.869852:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130008704 00000100:00100000:2.0:1789607448.869956:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:2.0:1789607448.869967:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:10609:x1876539130008704:12345-192.168.203.25@tcp:101:chown.0 00010000:00010000:2.0:1789607448.869993:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607448.870013:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668861 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.870085:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd799 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.870099:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.870109:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607448.870144:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607448.870148:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607448.870185:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.870236:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbd792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668861 expref: 11 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.870273:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668861 expref: 10 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.870281:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607448.870284:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607448.870288:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d600, rc 0) 00000100:00100000:2.0:1789607448.870352:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:10609:x1876539130008704:12345-192.168.203.25@tcp:101:chown.0 Request processed in 386us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607448.870359:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:0.0:1789607448.873538:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.873716:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130008832 00000100:00100000:2.0:1789607448.873727:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130008832 00000100:00100000:2.0:1789607448.873779:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:2.0:1789607448.873790:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:10609:x1876539130008832:12345-192.168.203.25@tcp:101:chown.0 00010000:00010000:2.0:1789607448.873810:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607448.873832:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c800/0xa26202d240fbd7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668868 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.873944:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.873959:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.873976:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.873988:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874004:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874012:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874098:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd7b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874106:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874113:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607448.874143:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607448.874147:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607448.874166:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874193:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874209:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874488:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874496:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607448.874500:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874516:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874528:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607448.874530:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607448.874535:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874541:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd7a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874553:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874559:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874564:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874569:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607448.874572:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874578:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874584:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d78c6f8c500) 00010000:00010000:2.0:1789607448.874586:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607448.874589:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874605:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874637:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c800/0xa26202d240fbd7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668868 expref: 12 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874651:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668868 expref: 11 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.874657:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607448.874660:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607448.874662:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581e00, rc 0) 00000100:00100000:2.0:1789607448.874727:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:10609:x1876539130008832:12345-192.168.203.25@tcp:101:chown.0 Request processed in 938us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607448.874734:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:1.0:1789607448.878419:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607448.878539:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130008960 00000100:00100000:3.0:1789607448.878548:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130008960 00000100:00100000:3.0:1789607448.878598:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1789607448.878606:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:10609:x1876539130008960:12345-192.168.203.25@tcp:900:chown.0 00000100:00100000:3.0:1789607448.878685:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:10609:x1876539130008960:12345-192.168.203.25@tcp:900:chown.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607448.878692:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1789607448.882245:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.882402:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130009216 00000100:00100000:2.0:1789607448.882412:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130009216 00000100:00100000:2.0:1789607448.882470:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:2.0:1789607448.882479:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:10609:x1876539130009216:12345-192.168.203.25@tcp:36:chown.0 00010000:00010000:2.0:1789607448.882528:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607448.882554:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd7b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668868 expref: 11 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.882572:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607448.882577:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607448.882599:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.882624:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.882635:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607448.941473:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1789607448.941569:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941583:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941591:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941598:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607448.941603:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941611:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941630:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d78c6f8c500) 00010000:00010000:1.0:1789607448.941633:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607448.941638:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941659:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbd76f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941680:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941687:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941693:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941698:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607448.941701:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941708:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941716:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607448.941718:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607448.941722:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941728:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbd776 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941740:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941747:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941759:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941765:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607448.941768:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941774:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941782:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:1.0:1789607448.941785:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607448.941788:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.941794:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbd78b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607448.942171:0:7709:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000319dfd0 reply state 0000000020e9436e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.942187:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607448.942196:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607448.942198:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789607448.942289:0:7709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789607448.942306:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789607448.942477:0:7709:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789607448.942499:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:10609:x1876539130009216:12345-192.168.203.25@tcp:36:chown.0 Request processed in 60016us (60257us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789607448.942508:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00010000:00010000:0.0:1789607448.942593:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.942602:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.942616:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.942622:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607448.942626:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.942633:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.942644:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:0.0:1789607448.942646:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789607448.942649:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.942656:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbd7bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607448.961143:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607448.961271:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130009344 00000100:00100000:2.0:1789607448.961281:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130009344 00000100:00100000:0.0:1789607448.962361:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:0.0:1789607448.962566:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:10610:x1876539130009344:12345-192.168.203.25@tcp:101:touch.500 00010000:00010000:0.0:1789607448.962664:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607448.962685:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbd7c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66886f expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607448.964703:0:12196:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1963us 00010000:00010000:0.0:1789607448.983902:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.983934:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.983956:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.983973:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.983980:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.983986:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984324:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c600/0xa26202d240fbd7d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984333:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c600/0xa26202d240fbd7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984341:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c600/0xa26202d240fbd7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607448.984362:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607448.984366:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607448.984402:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c600/0xa26202d240fbd7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984414:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984421:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984438:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984444:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075dc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607448.984448:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984456:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984468:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:0.0:1789607448.984471:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607448.984475:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984482:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbd7ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984493:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984498:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984503:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984507:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607448.984509:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984524:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984532:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d78c73e1b00) 00010000:00010000:0.0:1789607448.984534:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607448.984537:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984543:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c800/0xa26202d240fbd7d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984594:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbd7c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66886f expref: 8 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984610:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c600/0xa26202d240fbd7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66886f expref: 7 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.984618:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607448.984621:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789607448.984623:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c600, rc 0) 00000100:00100000:0.0:1789607448.984696:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:10610:x1876539130009344:12345-192.168.203.25@tcp:101:touch.500 Request processed in 22323us (23563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607448.984705:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:3.0:1789607448.988737:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607448.988822:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130009600 00000100:00100000:0.0:1789607448.988832:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130009600 00000100:00100000:0.0:1789607448.988913:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1789607448.988923:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:10610:x1876539130009600:12345-192.168.203.25@tcp:101:touch.500 00010000:00010000:0.0:1789607448.988959:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607448.988991:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbd7df lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668876 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.989368:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.989383:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.989396:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.989460:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.989468:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607448.989474:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607448.995979:0:6468:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789607448.996330:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd7f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996346:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996357:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996388:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996404:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996411:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996417:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607448.996421:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996428:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996439:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607448.996442:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607448.996447:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996453:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbd7e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607448.996476:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000119a3dd7 reply state 000000001f62db1d transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996486:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996492:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd0fcc536 (ffff8d78c73e1600) 00010000:00010000:1.0:1789607448.996495:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607448.996498:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607448.996530:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbd7df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668876 expref: 10 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996549:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668876 expref: 9 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607448.996556:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:1.0:1789607448.996559:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607448.996561:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031200, rc 0) 00000100:00100000:1.0:1789607448.996624:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:10610:x1876539130009600:12345-192.168.203.25@tcp:101:touch.500 Request processed in 7703us (7896us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789607448.996632:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1789607449.004194:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.004278:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130009856 00000100:00100000:2.0:1789607449.004287:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130009856 00000100:00100000:2.0:1789607449.004343:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1789607449.004352:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:10610:x1876539130009856:12345-192.168.203.25@tcp:36:touch.500 00010000:00010000:2.0:1789607449.004414:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607449.004440:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd7f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668876 expref: 10 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.004484:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:2.0:1789607449.004495:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607449.004537:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.004549:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.004558:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607449.004787:0:7709:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f07bab43 reply state 00000000f5931364 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.004799:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.004804:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607449.004807:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607449.004810:0:7709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607449.005015:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:10610:x1876539130009856:12345-192.168.203.25@tcp:36:touch.500 Request processed in 663us (830us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789607449.005023:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:0.0:1789607449.009551:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.009723:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130009984 00000100:00100000:2.0:1789607449.009732:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130009984 00000100:00100000:2.0:1789607449.009824:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:2.0:1789607449.009835:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:10610:x1876539130009984:12345-192.168.203.25@tcp:101:touch.500 00010000:00010000:2.0:1789607449.009858:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607449.009925:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd809 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66887d expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.009985:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd809 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66887d expref: 12 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.010000:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd809 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66887d expref: 12 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.010020:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607449.010023:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607449.010027:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580a00, rc 0) 00000100:00100000:2.0:1789607449.010094:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+12:10610:x1876539130009984:12345-192.168.203.25@tcp:101:touch.500 Request processed in 261us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607449.010101:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:1.0:1789607449.015041:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607449.015216:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130010112 00000100:00100000:3.0:1789607449.015236:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130010112 00000100:00100000:3.0:1789607449.015279:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:3.0:1789607449.015287:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876539130010112:12345-192.168.203.25@tcp:8:touch.500 00010000:00080000:3.0:1789607449.015322:0:8113:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:3.0:1789607449.015353:0:8113:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbd810 00002000:00100000:3.0:1789607449.015364:0:8113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8/ffff8d78cfc3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607449.015396:0:8113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789607449.015637:0:8113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789607449.015667:0:8113:0:(import.c:65:import_set_state_nolock()) ffff8d78cfc3d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607449.015731:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539130010112:12345-192.168.203.25@tcp:8:touch.500 Request processed in 442us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607449.015739:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1789607449.019166:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.019314:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130010240 00000100:00100000:2.0:1789607449.019324:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130010240 00000100:00100000:2.0:1789607449.019488:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607449.019499:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:0:x1876539130010240:12345-192.168.203.25@tcp:2:touch.500 00000100:00080000:3.0:1789607449.025771:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789607449.084089:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1789607449.084106:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000100:00100000:2.0:1789607449.084338:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:0:x1876539130010240:12345-192.168.203.25@tcp:2:touch.500 Request processed in 64837us (65176us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789607449.084349:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1789607449.087034:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.087194:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130010496 00000100:00100000:2.0:1789607449.087210:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130010496 00000100:00100000:2.0:1789607449.087275:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1789607449.087286:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+12:10610:x1876539130010496:12345-192.168.203.25@tcp:35:touch.500 00000100:00100000:2.0:1789607449.087609:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:10610:x1876539130010496:12345-192.168.203.25@tcp:35:touch.500 Request processed in 324us (584us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789607449.087627:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:3.0:1789607449.091783:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607449.091824:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607449.091858:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607449.091921:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607449.091949:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130010752 00000100:00100000:3.0:1789607449.091957:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130010752 00000100:00100000:3.0:1789607449.092011:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130011008 00000100:00100000:3.0:1789607449.092014:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130011008 00000100:00100000:3.0:1789607449.092033:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130010880 00000100:00100000:3.0:1789607449.092036:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130010880 00000100:00100000:3.0:1789607449.092055:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:3.0:1789607449.092080:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130010752:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607449.092148:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130010752:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 71us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607449.092156:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:3.0:1789607449.092172:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:3.0:1789607449.092178:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130011008:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607449.092201:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130011008:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 23us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607449.092218:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:3.0:1789607449.092239:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:3.0:1789607449.092260:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130010880:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607449.092287:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130010880:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607449.092293:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00080000:3.0:1789607449.092313:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607449.092317:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607449.092683:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130010624 00000100:00100000:0.0:1789607449.092689:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130010624 00000100:00100000:0.0:1789607449.092726:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 335 00000100:00100000:0.0:1789607449.092733:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130010624:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607449.092774:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130010624:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607449.092781:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 335 00000100:00100000:3.0:1789607449.108152:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607449.108421:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130011136 00000100:00100000:0.0:1789607449.108431:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130011136 00000100:00100000:0.0:1789607449.108486:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1789607449.108496:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:10611:x1876539130011136:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:0.0:1789607449.108521:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607449.108543:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668884 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.108607:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbd81e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.108620:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbd81e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.108633:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbd81e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607449.108666:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607449.108669:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607449.108715:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbd81e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.108739:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668884 expref: 15 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.108755:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbd81e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668884 expref: 14 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.108775:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607449.108778:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607449.108781:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8200, rc 0) 00000100:00100000:0.0:1789607449.108843:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:10611:x1876539130011136:12345-192.168.203.25@tcp:101:rm.0 Request processed in 348us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607449.108850:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1789607449.112935:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.113171:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130011392 00000100:00100000:2.0:1789607449.113182:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130011392 00000100:00100000:2.0:1789607449.113261:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:2.0:1789607449.113273:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:10611:x1876539130011392:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:2.0:1789607449.113294:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607449.113314:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66888b expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607449.113413:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607449.113558:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd825 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66888b expref: 16 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.113573:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607449.113575:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607449.113580:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66888b expref: 16 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.113593:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581400, rc 0) 00000100:00100000:2.0:1789607449.113654:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:10611:x1876539130011392:12345-192.168.203.25@tcp:101:rm.0 Request processed in 383us (728us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789607449.113661:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:1.0:1789607449.122921:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.123007:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130011520 00000100:00100000:2.0:1789607449.123017:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130011520 00000100:00100000:2.0:1789607449.123064:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:2.0:1789607449.123075:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:10611:x1876539130011520:12345-192.168.203.25@tcp:37:rm.0 00000100:00100000:2.0:1789607449.127650:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:10611:x1876539130011520:12345-192.168.203.25@tcp:37:rm.0 Request processed in 4567us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607449.127662:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:3.0:1789607449.132235:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607449.132368:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130011776 00000100:00100000:0.0:1789607449.132377:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130011776 00000100:00100000:0.0:1789607449.132438:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607449.132448:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0070450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:10611:x1876539130011776:12345-192.168.203.25@tcp:35:rm.0 00000100:00100000:0.0:1789607449.132665:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0070450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:10611:x1876539130011776:12345-192.168.203.25@tcp:35:rm.0 Request processed in 217us (448us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789607449.132672:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1789607449.136143:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.136249:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130012032 00000100:00100000:2.0:1789607449.136259:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130012032 00000100:00100000:2.0:1789607449.136318:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:2.0:1789607449.136328:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:10611:x1876539130012032:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:2.0:1789607449.136351:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607449.136372:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668892 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.136484:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbd83a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.136499:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbd83a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.136510:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbd83a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607449.136519:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607449.136629:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668892 expref: 19 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.136648:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbd83a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668892 expref: 18 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.136656:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:2.0:1789607449.136672:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607449.136676:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580200, rc 0) 00000100:00100000:2.0:1789607449.136748:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130012032:12345-192.168.203.25@tcp:101:rm.0 Request processed in 422us (613us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789607449.136756:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:3.0:1789607449.144808:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607449.144923:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130012160 00000100:00100000:0.0:1789607449.144933:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130012160 00000100:00100000:0.0:1789607449.144989:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:0.0:1789607449.145000:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130012160:12345-192.168.203.25@tcp:41:rm.0 00000004:00000024:0.0:1789607449.145062:0:6469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789607449.145134:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130012160:12345-192.168.203.25@tcp:41:rm.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607449.145141:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:3.0:1789607449.149564:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607449.149661:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130012288 00000100:00100000:0.0:1789607449.149670:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130012288 00000100:00100000:0.0:1789607449.149731:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:0.0:1789607449.149741:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130012288:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:0.0:1789607449.149767:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607449.149788:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd848 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668899 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.149846:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.149893:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.149906:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.149917:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.149924:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.149929:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150022:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150030:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150037:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607449.150061:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789607449.150073:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607449.150093:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150105:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150113:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150119:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150125:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150131:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607449.150136:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150144:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150155:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607449.150158:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607449.150162:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150169:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd84f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150181:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150211:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150218:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150232:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607449.150236:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150243:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150251:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd0fcc536 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607449.150254:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607449.150257:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150262:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd856 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150289:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd848 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668899 expref: 20 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150303:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668899 expref: 19 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.150310:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:0.0:1789607449.150312:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607449.150320:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8600, rc 0) 00000100:00100000:0.0:1789607449.150376:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:10611:x1876539130012288:12345-192.168.203.25@tcp:101:rm.0 Request processed in 637us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607449.150383:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:1.0:1789607449.156157:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607449.156428:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130012544 00000100:00100000:0.0:1789607449.156439:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130012544 00000100:00100000:0.0:1789607449.156502:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:0.0:1789607449.156513:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:10611:x1876539130012544:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:0.0:1789607449.156565:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789607449.156591:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbd85d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668899 expref: 19 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156609:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580a00/0xa26202d240fbd809 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66887d expref: 18 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156619:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:0.0:1789607449.156628:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbd81e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668884 expref: 17 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156635:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607449.156639:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607449.156658:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156671:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156691:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156720:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156729:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156735:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156892:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156901:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.156909:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607449.157780:0:6470:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789607449.157791:0:6470:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354114928868ns, next at 355114926640ns, rc = 0 00010000:00010000:0.0:1789607449.157853:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157893:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157903:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157910:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157927:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157934:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157953:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607449.157974:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157979:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157986:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.157991:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607449.157995:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158002:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158013:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:0.0:1789607449.158016:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789607449.158021:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158027:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd872 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158044:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158055:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158061:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158066:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607449.158069:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158075:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158083:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607449.158086:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607449.158089:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158094:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd864 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607449.158103:0:6470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000291aef61 reply state 00000000134496ee transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158114:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607449.158120:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd0fcc536 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607449.158123:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789607449.158126:0:6470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607449.158989:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607449.158999:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607449.159008:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607449.159012:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607449.159020:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607449.159033:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607449.159044:0:6457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789607449.159049:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607449.159054:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd879 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607449.159066:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607449.159067:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607449.159069:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607449.159146:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130012544:12345-192.168.203.25@tcp:36:rm.0 Request processed in 2629us (2993us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789607449.159162:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:3.0:1789607449.162821:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607449.163107:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130012800 00000100:00100000:0.0:1789607449.163117:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130012800 00000100:00100000:0.0:1789607449.163169:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1789607449.163179:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130012800:12345-192.168.203.25@tcp:35:rm.0 00000100:00100000:0.0:1789607449.163424:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:10611:x1876539130012800:12345-192.168.203.25@tcp:35:rm.0 Request processed in 246us (613us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789607449.163432:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1789607449.167400:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607449.167538:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013056 00000100:00100000:2.0:1789607449.167548:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013056 00000100:00100000:2.0:1789607449.167610:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1789607449.167620:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:10611:x1876539130013056:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:2.0:1789607449.167690:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789607449.167719:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbd83a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668892 expref: 19 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.167742:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c600/0xa26202d240fbd7d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66886f expref: 18 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.167753:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:2.0:1789607449.167771:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbd799 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668861 expref: 17 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.167779:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607449.167787:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607449.167808:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.167820:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.167829:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.167856:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.168133:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.168143:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.168401:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.168410:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.168417:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607449.169510:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607449.169527:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169535:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169542:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169548:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607449.169553:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169570:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169582:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607449.169584:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789607449.169588:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169595:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbd88e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169615:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169622:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169628:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169632:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607449.169635:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169640:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169646:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c6f8c800) 00010000:00010000:2.0:1789607449.169648:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607449.169651:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169663:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbd880 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607449.169980:0:7709:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d93664c reply state 000000009f063ee7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.169993:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607449.170000:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d78c6f8c400) 00010000:00010000:2.0:1789607449.170001:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607449.170005:0:7709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607449.170133:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:10611:x1876539130013056:12345-192.168.203.25@tcp:36:rm.0 Request processed in 2511us (2738us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789607449.170141:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:0.0:1789607449.315597:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150021632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607449.315669:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607449.315945:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021632 00000100:00100000:3.0:1789607449.315953:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021632 00000100:00100000:3.0:1789607449.316007:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789607449.316015:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150021632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607449.316036:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607449.316097:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150021632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607449.316103:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789607449.316127:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607449.316156:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5f19180 x1876539150021632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607449.316184:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150021632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607449.316710:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150021888:0@lo:400:kworker.0 00000100:00100000:0.0:1789607449.316747:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607449.316772:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150022400:0@lo:400:kworker.0 00000100:00100000:0.0:1789607449.316795:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607449.316827:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150022912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607449.316855:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317301:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150022016:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317338:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317360:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150022528:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317393:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317413:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150023040:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317433:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317460:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789607449.317465:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150022144:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317485:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317502:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150022656:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317520:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317535:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150023168:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317551:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317574:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150021760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607449.317595:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317610:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150022272:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317631:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607449.317659:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150022784:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317701:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022400 00000100:00100000:1.0:1789607449.317708:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022400 00000100:00100000:1.0:1789607449.317750:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022144 00000100:00100000:1.0:1789607449.317753:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022144 00000100:00100000:1.0:1789607449.317766:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789607449.317773:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150022400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317818:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150022400:12345-0@lo:400:kworker.0 Request processed in 45us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.317825:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789607449.317840:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607449.317846:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150022144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317905:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150022144:12345-0@lo:400:kworker.0 Request processed in 58us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.317922:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607449.317956:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150022144:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.317977:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022016 00000100:00100000:1.0:1789607449.317980:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022016 00000100:00100000:1.0:1789607449.317998:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022528 00000100:00100000:1.0:1789607449.318000:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022528 00000100:00100000:1.0:1789607449.318019:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023040 00000100:00100000:1.0:1789607449.318021:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023040 00000100:00100000:1.0:1789607449.318032:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022656 00000100:00100000:1.0:1789607449.318034:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022656 00000100:00100000:1.0:1789607449.318043:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023168 00000100:00100000:1.0:1789607449.318045:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023168 00000100:00100000:1.0:1789607449.318055:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022272 00000100:00100000:1.0:1789607449.318068:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022272 00000100:00100000:1.0:1789607449.318081:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789607449.318093:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150022016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.318128:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150022016:12345-0@lo:400:kworker.0 Request processed in 35us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.318134:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789607449.318146:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789607449.318152:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150022528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.318183:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150022528:12345-0@lo:400:kworker.0 Request processed in 32us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.318189:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789607449.318211:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789607449.318218:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150023040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.318259:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150023040:12345-0@lo:400:kworker.0 Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.318265:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789607449.318280:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789607449.318288:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607449.318298:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021888 00000100:00100000:2.0:1789607449.318305:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021888 00000100:00100000:1.0:1789607449.318321:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150022656:12345-0@lo:400:kworker.0 Request processed in 34us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.318327:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789607449.318341:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789607449.318346:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789607449.318354:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150021888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.318357:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150023168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.318403:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150023168:12345-0@lo:400:kworker.0 Request processed in 50us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.318409:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789607449.318420:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789607449.318433:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150022272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607449.318484:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150021888:12345-0@lo:400:kworker.0 Request processed in 133us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.318486:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150022272:12345-0@lo:400:kworker.0 Request processed in 54us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607449.318499:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789607449.318500:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1789607449.318527:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607449.318532:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607449.318545:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150021760 00000100:00100000:2.0:1789607449.318550:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150021760 00010000:00080000:1.0:1789607449.318561:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700000 x1876539150022656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607449.318573:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150022656:0@lo:400:kworker.0 00010000:00080000:1.0:1789607449.318588:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0702d80 x1876539150023168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607449.318591:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607449.318602:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150023168:0@lo:400:kworker.0 00000100:00100000:2.0:1789607449.318605:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150021760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607449.318618:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150022016:0@lo:400:kworker.0 00002000:00000024:2.0:1789607449.318623:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607449.318630:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150022528:0@lo:400:kworker.0 00000100:00100000:1.0:1789607449.318641:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150023040:0@lo:400:kworker.0 00000100:00100000:2.0:1789607449.318671:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150021760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607449.318686:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789607449.318714:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607449.319114:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150021888:0@lo:400:kworker.0 00000100:00100000:0.0:1789607449.319128:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150022400:0@lo:400:kworker.0 00000100:00100000:3.0:1789607449.319239:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607449.319459:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022912 00000100:00100000:2.0:1789607449.319464:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022912 00000100:00100000:3.0:1789607449.319526:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150023296:0@lo:400:kworker.0 00000100:00100000:3.0:1789607449.319566:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607449.319712:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150022784 00000100:00100000:0.0:1789607449.319712:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023296 00000100:00100000:2.0:1789607449.319717:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150022784 00000100:00100000:0.0:1789607449.319717:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023296 00000100:00100000:2.0:1789607449.319740:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789607449.319747:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150022912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607449.319804:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789607449.319810:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150022784:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789607449.321171:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78faae1c00 x1876539150021760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607449.321319:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150021760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607449.321341:0:9649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789607449.321352:0:9649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789607449.321481:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150022784:12345-0@lo:400:kworker.0 Request processed in 1667us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.321499:0:8112:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789607449.321505:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789607449.321514:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789607449.321527:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150023296:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789607449.321536:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607449.321581:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150023296:12345-0@lo:400:kworker.0 Request processed in 59us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607449.321589:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607449.322533:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150022272:0@lo:400:kworker.0 00010000:00080000:3.0:1789607449.322554:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0700700 x1876539150022784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607449.322561:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150022912:12345-0@lo:400:kworker.0 Request processed in 2811us (5701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607449.322569:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150022784:0@lo:400:kworker.0 00000100:00100000:2.0:1789607449.322575:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1789607449.322587:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703100 x1876539150023296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607449.322595:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150023296:0@lo:400:kworker.0 00010000:00080000:0.0:1789607449.323019:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0701500 x1876539150022912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607449.323029:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150022912:0@lo:400:kworker.0 00010000:00010000:0.0:1789607449.828852:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607450.855724:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607451.371107:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150023424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607451.371177:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607451.374174:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023424 00000100:00100000:3.0:1789607451.374185:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023424 00000100:00100000:3.0:1789607451.374267:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789607451.374278:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150023424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607451.374315:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607451.374402:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150023424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (3225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607451.374408:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789607451.374430:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607451.374443:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150023552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607451.374480:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789607451.374518:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607451.374529:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023552 00000100:00100000:3.0:1789607451.374532:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023552 00000100:00100000:3.0:1789607451.374559:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789607451.374565:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150023552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607451.374575:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607451.374606:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150023552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607451.374612:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1789607451.374644:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607451.374677:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaeed80 x1876539150023424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607451.374697:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150023424:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789607451.374728:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c12e8000 x1876539150023552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607451.374739:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150023552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789607451.874116:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607451.875142:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607451.875163:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150023680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607451.875241:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607451.875648:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023680 00000100:00100000:2.0:1789607451.875656:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023680 00000100:00100000:2.0:1789607451.875707:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789607451.875715:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150023680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607451.875754:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607451.875811:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150023680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607451.875819:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789607451.876181:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150023680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607452.390061:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150023808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607452.390162:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607452.391040:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023808 00000100:00100000:1.0:1789607452.391052:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023808 00000100:00100000:1.0:1789607452.391120:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789607452.391131:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150023808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607452.391175:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607452.392520:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150023808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1379us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607452.392535:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789607452.393349:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150023808:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789607452.783346:0:13219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789607452.902573:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607453.923040:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789607453.967915:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000004:00080000:0.0:1789607453.967931:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789607453.967960:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:0.0:1789607453.967987:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.967998:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968008:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968014:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607453.968018:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968166:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968202:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd0fcc536 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607453.968205:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607453.968210:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968216:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd7ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968233:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968238:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968243:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968247:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607453.968250:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968255:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968262:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:0.0:1789607453.968274:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607453.968278:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968284:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbd802 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607453.968286:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607453.968302:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150023936:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789607453.968312:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968318:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968322:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968327:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607453.968330:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968335:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968342:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd0fcc536 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607453.968345:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607453.968347:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968353:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd86b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd0fcc536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968374:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968380:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968385:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968396:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607453.968400:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968406:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968414:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d78c6f8c400) 00010000:00010000:0.0:1789607453.968416:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607453.968419:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968425:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd887 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607453.968498:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607453.968539:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150023936 00000100:00100000:0.0:1789607453.968547:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150023936 00000100:00100000:0.0:1789607453.968601:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607453.968614:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790030ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150023936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789607453.968639:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789607453.968670:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aab3e19, atime: 0x6aab3e19, ctime: 0x6aab3e19, blocks: 0x1 00010000:00010000:0.0:1789607453.968677:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968691:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789607453.968695:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607453.968702:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789607453.968716:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789607453.968811:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968821:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968828:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607453.968850:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607453.969011:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607453.969018:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607453.969025:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607453.969029:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607453.969048:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607453.969062:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607453.969068:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbd895 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607453.969083:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607453.969085:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607453.969087:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607453.969935:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790030ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150023936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1322us (1434us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789607453.969945:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789607453.970984:0:3470:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78efaed180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789607453.970995:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150023936:0@lo:6:osp-syn-1-0.0 00000020:00000080:1.0:1789607454.184888:0:13268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1ae2e8d0 20000000:00000080:1.0:1789607454.184905:0:13268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d78f63c3c00 uarg=0000000000000000 20000000:01000000:1.0:1789607454.184945:0:13268:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789607454.184951:0:13268:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789607454.184956:0:13268:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789607454.186617:0:13269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789607454.186773:0:13268:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789607454.200831:0:13268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789607454.201257:0:13268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789607454.201327:0:13268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789607454.201345:0:13268:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789607454.201365:0:13268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201392:0:13268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd722 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201401:0:13268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd730 expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201407:0:13268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd73e expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201414:0:13268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd74c expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201423:0:13268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201429:0:13268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201435:0:13268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201473:0:13268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201489:0:13268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 12 pid: 6462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.201503:0:13268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024064:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607454.201647:0:13268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 12 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201662:0:13268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 12 pid: 6464 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.201672:0:13268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024192:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607454.201712:0:13268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd74c expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.201721:0:13268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd74c expref: 23 pid: 6464 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.201732:0:13268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024320:0@lo:104: 00000100:00100000:2.0:1789607454.201774:0:13268:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607454.202199:0:13268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd73e expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.202208:0:13268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd73e expref: 23 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.202217:0:13268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024448:0@lo:104: 00010000:00010000:2.0:1789607454.202246:0:13268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd730 expref: 23 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.202254:0:13268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd730 expref: 23 pid: 6463 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.202261:0:13268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024576:0@lo:104: 00010000:00010000:2.0:1789607454.202283:0:13268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbd722 expref: 23 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.202298:0:13268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbd722 expref: 23 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.202306:0:13268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024704:0@lo:104: 00000100:00100000:2.0:1789607454.202326:0:13268:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607454.208622:0:6453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607454.208671:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.208704:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.208721:0:6453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.208730:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150024320 00000100:00100000:3.0:1789607454.208739:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150024320 00000100:00100000:3.0:1789607454.208775:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150024448 00000100:00100000:3.0:1789607454.208777:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150024448 00000100:00100000:3.0:1789607454.208785:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150024576 00000100:00100000:3.0:1789607454.208787:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150024576 00000100:00100000:3.0:1789607454.208794:0:6453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150024704 00000100:00100000:3.0:1789607454.208796:0:6453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150024704 00000100:00100000:3.0:1789607454.208806:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607454.208814:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d79011ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+6:13268:x1876539150024320:12345-0@lo:104: 00010000:00010000:3.0:1789607454.208842:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.208922:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607454.208929:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d79011ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+6:13268:x1876539150024320:12345-0@lo:104: Request processed in 116us (7155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.208942:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607454.208980:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607454.208986:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:13268:x1876539150024448:12345-0@lo:104: 00010000:00010000:3.0:1789607454.208993:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.209021:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607454.209025:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+5:13268:x1876539150024448:12345-0@lo:104: Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.209031:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607454.209040:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607454.209045:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:13268:x1876539150024576:12345-0@lo:104: 00010000:00010000:3.0:1789607454.209052:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.209081:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789607454.209086:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+4:13268:x1876539150024576:12345-0@lo:104: Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.209092:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607454.209103:0:6453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607454.209109:0:6453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:13268:x1876539150024704:12345-0@lo:104: 00010000:00010000:3.0:1789607454.209122:0:6453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.209149:0:6453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789607454.209154:0:6453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c0415db0-4674-4bfe-9696-a490439e72d4+3:13268:x1876539150024704:12345-0@lo:104: Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607454.209322:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607454.209341:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607454.209360:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013184 00000100:00100000:0.0:1789607454.209363:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013184 00010000:00010000:0.0:1789607454.209383:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 13 pid: 6462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607454.209402:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013312 00000100:00100000:0.0:1789607454.209404:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013312 00010000:00010000:0.0:1789607454.209413:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 14 pid: 6464 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607454.209427:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:0.0:1789607454.209433:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+14:2396:x1876539130013184:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607454.209449:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607454.209455:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 14 pid: 6462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607454.209466:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 14 pid: 6462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607454.209484:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607454.209514:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+14:2396:x1876539130013184:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607454.209520:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:0.0:1789607454.209532:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1789607454.209538:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130013312:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607454.209545:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607454.209549:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 13 pid: 6464 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607454.209558:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 13 pid: 6464 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607454.209567:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607454.209581:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130013312:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 43us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607454.209586:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00010000:00010000:2.0:1789607454.209746:0:13268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052c00/0xa26202d240fbd761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668853 expref: 12 pid: 6462 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.209761:0:13268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024064:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607454.209770:0:13268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075ce00/0xa26202d240fbd75a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66884c expref: 11 pid: 6464 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607454.209778:0:13268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024192:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607454.209786:0:13268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024320:0@lo:104: 00000100:00100000:2.0:1789607454.209793:0:13268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024448:0@lo:104: 00000100:00100000:2.0:1789607454.209798:0:13268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024576:0@lo:104: 00000100:00100000:2.0:1789607454.209804:0:13268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13268:1876539150024704:0@lo:104: 00010000:00010000:2.0:1789607454.209830:0:13268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213614:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789607454.213630:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213644:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59da00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607454.213649:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213680:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607454.213689:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607454.213695:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607454.213746:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213752:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607454.213791:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213798:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbd74c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd753 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213817:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607454.213821:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213827:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59ca00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607454.213830:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213838:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607454.213845:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607454.213856:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607454.213888:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213895:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607454.213902:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213909:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ca00/0xa26202d240fbd73e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd745 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213918:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607454.213921:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213926:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607454.213929:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213936:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607454.213942:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607454.213947:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607454.213958:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213963:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607454.213984:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.213991:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902053200/0xa26202d240fbd730 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd737 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.214001:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607454.214005:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.214011:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607454.214013:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.214020:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607454.214026:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607454.214030:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607454.214041:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.214046:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607454.214051:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.214057:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbd722 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbd729 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.214071:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607454.214079:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607454.214081:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607454.214089:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607454.214094:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607454.214111:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150025216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.214459:0:6453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607454.214497:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150024960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.214542:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.214589:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607454.214595:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150024832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.214616:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.214646:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150024960 00000100:00100000:3.0:1789607454.214653:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150024960 00010000:00010000:3.0:1789607454.214681:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd73e expref: 24 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607454.214701:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150024832 00000100:00100000:3.0:1789607454.214704:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150024832 00010000:00010000:3.0:1789607454.214713:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd74c expref: 25 pid: 6464 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607454.214725:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607454.214731:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+25:3469:x1876539150024960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607454.214744:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607454.214749:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd73e expref: 25 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.214758:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd73e expref: 25 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.214780:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902053c00/0xa26202d240fbd745 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd73e expref: 25 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.214793:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607454.214826:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150024960:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.214832:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607454.214846:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607454.214852:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+23:3469:x1876539150024832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607454.214888:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607454.214894:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd74c expref: 23 pid: 6464 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.214903:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd74c expref: 23 pid: 6464 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.214913:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbd753 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd74c expref: 23 pid: 6464 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.214923:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607454.214946:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+22:3469:x1876539150024832:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.214952:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607454.215001:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607454.215057:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607454.215109:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607454.215134:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607454.215154:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150025088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.215206:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.215247:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150024832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.215256:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150024960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.215279:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013696 00000100:00100000:3.0:1789607454.215283:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013696 00000100:00100000:3.0:1789607454.215320:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:3.0:1789607454.215328:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130013696:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607454.215380:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130013696:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.215387:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:3.0:1789607454.215402:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025088 00000100:00100000:3.0:1789607454.215405:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025088 00010000:00010000:3.0:1789607454.215418:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd730 expref: 22 pid: 6463 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607454.215431:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607454.215438:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+22:3470:x1876539150025088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607454.215445:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607454.215449:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd730 expref: 22 pid: 6463 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.215457:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd730 expref: 22 pid: 6463 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.215468:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbd737 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd730 expref: 22 pid: 6463 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.215487:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607454.215516:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+21:3470:x1876539150025088:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.215523:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789607454.215539:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607454.215559:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150025088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607454.216012:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013568 00000100:00100000:1.0:1789607454.216018:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013568 00000100:00100000:1.0:1789607454.216061:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013440 00000100:00100000:1.0:1789607454.216065:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013440 00000100:00100000:1.0:1789607454.216082:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013952 00000100:00100000:1.0:1789607454.216084:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013952 00000100:00100000:1.0:1789607454.216098:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 226 00000100:00100000:1.0:1789607454.216105:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130013568:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607454.216151:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130013568:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 46us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.216157:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 226 00000100:00100000:1.0:1789607454.216192:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:1.0:1789607454.216200:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130013440:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607454.216232:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130013440:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 34us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.216237:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:1.0:1789607454.216249:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 228 00000100:00100000:1.0:1789607454.216255:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130013952:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607454.216277:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130013952:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.216283:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 228 00000100:00080000:2.0:1789607454.217091:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607454.217098:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607454.219473:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607454.219601:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607454.219634:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130013824 00000100:00100000:1.0:1789607454.219644:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130013824 00000100:00100000:1.0:1789607454.219705:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:1.0:1789607454.219716:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130013824:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607454.219783:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130013824:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.219790:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00080000:1.0:1789607454.219812:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607454.221998:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025216 00000100:00100000:2.0:1789607454.222014:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025216 00010000:00010000:3.0:1789607454.228856:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd722 expref: 21 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607454.229142:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607454.229154:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+21:3471:x1876539150025216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607454.229294:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607454.229301:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbd722 expref: 21 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229314:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbd722 expref: 21 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229332:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d200/0xa26202d240fbd729 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbd722 expref: 21 pid: 6462 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229347:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229355:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229389:0:6454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229395:0:6454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229402:0:6454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229408:0:6454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229415:0:6454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607454.229419:0:6454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.229428:0:6454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.232961:0:13268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607454.232980:0:13268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.236545:0:6454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.236564:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581000/0xa26202d240fbd89c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607454.236584:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607454.236811:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0415db0-4674-4bfe-9696-a490439e72d4+20:3471:x1876539150025216:12345-0@lo:103:ldlm_bl.0 Request processed in 7657us (17343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607454.236882:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150025216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607454.236948:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607454.435631:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607454.435677:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150025344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607454.435781:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607454.435900:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025344 00000100:00100000:3.0:1789607454.435910:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025344 00000100:00100000:3.0:1789607454.435968:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607454.435978:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150025344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607454.436028:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607454.436082:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150025344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.436104:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607454.436518:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150025344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607454.438287:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150025472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607454.438549:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607454.440506:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150025856:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.440569:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607454.440640:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025856 00000100:00100000:1.0:1789607454.440648:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025856 00000100:00100000:1.0:1789607454.440694:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789607454.440702:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150025856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.440757:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150025856:12345-0@lo:400:kworker.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.440764:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789607454.440812:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150025856:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.440845:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607454.440852:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150025984:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.440897:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607454.440927:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025984 00000100:00100000:1.0:1789607454.440931:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025984 00000100:00100000:1.0:1789607454.440957:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789607454.440963:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150025984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.441000:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150025984:12345-0@lo:400:kworker.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.441006:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789607454.441031:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150025984:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.441071:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150026368:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.441096:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607454.441124:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026368 00000100:00100000:1.0:1789607454.441128:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026368 00000100:00100000:1.0:1789607454.441159:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789607454.441180:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150026368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.441223:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150026368:12345-0@lo:400:kworker.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.441237:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789607454.441254:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607454.441276:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901377480 x1876539150026368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607454.441286:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150026368:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.441313:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607454.441319:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150026496:0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.441344:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607454.442226:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026496 00000100:00100000:0.0:1789607454.442241:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026496 00000100:00100000:0.0:1789607454.442279:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789607454.442285:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150026496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607454.442344:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150026496:12345-0@lo:400:kworker.0 Request processed in 59us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607454.442351:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789607454.442714:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607454.442748:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901377480 x1876539150026496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607454.442760:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150026496:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444315:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150025728:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444429:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607454.444483:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150026240:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444513:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607454.444545:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150026752:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444568:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607454.444598:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789607454.444606:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150025600:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444629:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607454.444648:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150026112:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444669:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607454.444712:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150026624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.444736:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607454.444783:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026240 00000100:00100000:2.0:1789607454.444793:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026240 00000100:00100000:2.0:1789607454.444856:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026752 00000100:00100000:2.0:1789607454.444880:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026752 00000100:00100000:2.0:1789607454.444896:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025600 00000100:00100000:2.0:1789607454.444900:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025600 00000100:00100000:2.0:1789607454.444912:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026112 00000100:00100000:2.0:1789607454.444915:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026112 00000100:00100000:2.0:1789607454.444928:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026624 00000100:00100000:2.0:1789607454.444930:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026624 00000100:00100000:2.0:1789607454.444947:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789607454.444958:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150026240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.445028:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150026240:12345-0@lo:400:kworker.0 Request processed in 71us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607454.445035:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789607454.445055:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789607454.445061:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150026752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.445509:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025728 00000100:00100000:1.0:1789607454.445523:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025728 00000100:00080000:0.0:1789607454.445784:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607454.445789:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607454.449219:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150025472 00000100:00100000:3.0:1789607454.449245:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150025472 00000100:00080000:0.0:1789607454.449526:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607454.451232:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150026752:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.452229:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789607454.452811:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150025728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607454.452923:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150025728:12345-0@lo:400:kworker.0 Request processed in 677us (8503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607454.452932:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789607454.453371:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789607454.453405:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150025472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607454.453442:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607454.453663:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150025472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 272us (15147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.453674:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789607454.454147:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150025472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607454.456593:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789607454.456610:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789607454.456641:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150025600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.456663:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789607454.456677:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150026112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.457678:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150026112:12345-0@lo:400:kworker.0 Request processed in 998us (12999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607454.457691:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789607454.457724:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789607454.457755:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150026624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.457806:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150026624:12345-0@lo:400:kworker.0 Request processed in 55us (13069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607454.457813:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789607454.458013:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150026112:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.458030:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150026624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.458044:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150025728:0@lo:400:kworker.0 00010000:00080000:2.0:1789607454.458061:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78efaeed80 x1876539150026240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607454.458074:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150026240:0@lo:400:kworker.0 00000100:00100000:3.0:1789607454.458109:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150025600:12345-0@lo:400:kworker.0 Request processed in 1485us (13477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607454.458119:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00080000:2.0:1789607454.461246:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc7b80 x1876539150026752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607454.461275:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150026752:0@lo:400:kworker.0 00000100:00100000:2.0:1789607454.461359:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150025600:0@lo:400:kworker.0 00000001:00080000:0.0:1789607454.506560:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1789607454.947808:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789607455.187709:0:13317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa71c90a0 20000000:00000080:0.0:1789607455.187733:0:13317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d78cfc98c00 uarg=0000000000000000 20000000:01000000:0.0:1789607455.187784:0:13317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789607455.187792:0:13317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789607455.187798:0:13317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1789607455.189029:0:13318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789607455.189312:0:13317:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789607455.189758:0:13317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1789607455.189812:0:13317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1789607455.189954:0:13317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1789607455.189972:0:13317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789607455.189998:0:13317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190030:0:13317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190043:0:13317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190051:0:13317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190127:0:13317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190135:0:13317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190142:0:13317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607455.190147:0:13317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190158:0:13317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190172:0:13317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190189:0:13317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607455.190197:0:13317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbd8a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607455.971738:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607456.196857:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607456.197018:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014080 00000100:00100000:2.0:1789607456.197029:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014080 00000100:00100000:2.0:1789607456.197089:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 337 00000100:00100000:2.0:1789607456.197100:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:6373:x1876539130014080:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.197117:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607456.197135:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580600/0xa26202d240fbd8aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688a0 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.197192:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580600/0xa26202d240fbd8aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688a0 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.197204:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580600/0xa26202d240fbd8aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688a0 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.197214:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580600, rc 0) 00000100:00100000:2.0:1789607456.197283:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130014080:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 185us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.197289:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 337 00000100:00100000:1.0:1789607456.200857:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607456.201029:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014208 00000100:00100000:3.0:1789607456.201051:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014208 00000100:00100000:3.0:1789607456.201109:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 338 00000100:00100000:3.0:1789607456.201120:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130014208:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607456.201444:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130014208:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 326us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607456.201452:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 338 00000100:00100000:3.0:1789607456.213755:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607456.213857:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014336 00000100:00100000:1.0:1789607456.213893:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014336 00000100:00100000:1.0:1789607456.213951:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 339 00000100:00100000:1.0:1789607456.213962:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130014336:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607456.214233:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130014336:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 271us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.214241:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 339 10000000:01000000:0.0:1789607456.226413:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789607456.226421:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f77e7800 from 7 10000000:01000000:0.0:1789607456.226427:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789607456.226477:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607456.226489:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607456.226501:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607456.226526:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150026880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.226594:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.226643:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.226966:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150026880 00000100:00100000:2.0:1789607456.226976:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150026880 00000100:00100000:2.0:1789607456.227020:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789607456.227030:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+20:6466:x1876539150026880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.227055:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607456.227069:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580800/0xa26202d240fbd8b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd8b1 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.227093:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580800/0xa26202d240fbd8b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd8b1 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.227104:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580800/0xa26202d240fbd8b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd8b1 expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.227111:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580800, rc 0) 00000100:00100000:2.0:1789607456.227163:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150026880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.227198:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789607456.227701:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150026880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607456.227724:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607456.227733:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607456.227795:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.227827:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.227881:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607456.227938:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027008 00000100:00100000:3.0:1789607456.227943:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027008 00000100:00100000:3.0:1789607456.227978:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789607456.227987:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150027008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607456.228259:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150027008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607456.228266:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789607456.228570:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.228606:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.228648:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.228678:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607456.229003:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607456.229043:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027136 00000100:00100000:1.0:1789607456.229049:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027136 00000100:00100000:1.0:1789607456.229074:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014464 00000100:00100000:1.0:1789607456.229076:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014464 00000100:00100000:1.0:1789607456.229090:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789607456.229098:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150027136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607456.229265:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150027136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.229272:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789607456.229302:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 343 00000100:00100000:1.0:1789607456.229310:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:10896:x1876539130014464:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607456.229889:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.230711:0:13330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13330:1876539150027264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.230762:0:13330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.230793:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027264 00000100:00100000:2.0:1789607456.230798:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027264 00000100:00100000:2.0:1789607456.230824:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789607456.230832:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:13330:x1876539150027264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607456.231429:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:10896:x1876539130014464:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 2115us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.231438:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 343 00000100:00100000:2.0:1789607456.231501:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+21:13330:x1876539150027264:12345-0@lo:502:llog_process_th.0 Request processed in 168us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.231507:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789607456.231551:0:13330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.231569:0:13330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13330:1876539150027264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607456.231595:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607456.231604:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.231606:0:13330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607456.231615:0:13330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78f77e7800 00000020:00000080:2.0:1789607456.231618:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607456.231676:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607456.231680:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.231681:0:13330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607456.231684:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607456.231687:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.231688:0:13330:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789607456.231691:0:13330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78f77e7800 00000020:00000080:2.0:1789607456.231693:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607456.231730:0:13330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13330:1876539150027392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.231765:0:13330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.231785:0:13330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607456.231987:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027392 00000100:00100000:3.0:1789607456.231992:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027392 00000100:00100000:3.0:1789607456.232026:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789607456.232040:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:13330:x1876539150027392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607456.232196:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+21:13330:x1876539150027392:12345-0@lo:502:llog_process_th.0 Request processed in 163us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607456.232203:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789607456.235303:0:13330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13330:1876539150027392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607456.235355:0:13330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607456.235363:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.235366:0:13330:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789607456.235372:0:13330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789607456.235437:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789607456.235469:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607456.235479:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.235490:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607456.235500:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607456.235503:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7901022000 from 7 10000000:01000000:2.0:1789607456.235506:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607456.235538:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.235546:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.235555:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607456.235575:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.235631:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.235665:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.235761:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027520 00000100:00100000:2.0:1789607456.235774:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027520 00000100:00100000:2.0:1789607456.235811:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789607456.235819:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+21:6466:x1876539150027520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.235832:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607456.235843:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbd8c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd8bf expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.235889:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbd8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd8bf expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.235900:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbd8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd8bf expref: 22 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.235908:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580a00, rc 0) 00000100:00100000:2.0:1789607456.235944:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150027520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.235952:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789607456.235983:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.235994:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.236003:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607456.236056:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.236080:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.236092:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.236102:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027648 00000100:00100000:2.0:1789607456.236111:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027648 00000100:00100000:2.0:1789607456.236132:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789607456.236138:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150027648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.236379:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150027648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.236387:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789607456.236416:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.236440:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.236474:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.236487:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.236498:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027776 00000100:00100000:2.0:1789607456.236501:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027776 00000100:00100000:2.0:1789607456.236520:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789607456.236525:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150027776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.236653:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150027776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.236659:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789607456.236695:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150027776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.236843:0:13331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13331:1876539150027904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.236898:0:13331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.236917:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150027904 00000100:00100000:2.0:1789607456.236921:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150027904 00000100:00100000:2.0:1789607456.236941:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789607456.236946:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:13331:x1876539150027904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.237063:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:13331:x1876539150027904:12345-0@lo:502:llog_process_th.0 Request processed in 116us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.237076:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789607456.237104:0:13331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.237116:0:13331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13331:1876539150027904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607456.237135:0:13331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607456.237142:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.237144:0:13331:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607456.237153:0:13331:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d7901022000 00000020:00000080:2.0:1789607456.237155:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607456.237216:0:13331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607456.237219:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.237221:0:13331:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607456.237224:0:13331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607456.237226:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.237228:0:13331:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789607456.237232:0:13331:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d7901022000 00000020:00000080:2.0:1789607456.237234:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607456.237263:0:13331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13331:1876539150028032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.237295:0:13331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.237313:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028032 00000100:00100000:2.0:1789607456.237317:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028032 00000100:00100000:2.0:1789607456.237338:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789607456.237344:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:13331:x1876539150028032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.237446:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:13331:x1876539150028032:12345-0@lo:502:llog_process_th.0 Request processed in 101us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.237452:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789607456.237479:0:13331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.237490:0:13331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13331:1876539150028032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607456.237516:0:13331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607456.237519:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.237521:0:13331:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789607456.237525:0:13331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789607456.237562:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789607456.237577:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607456.237585:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237595:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607456.237605:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607456.237607:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78f05a9800 from 7 10000000:01000000:2.0:1789607456.237610:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607456.237629:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237637:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237646:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607456.237659:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.237684:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.237696:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.237707:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028160 00000100:00100000:2.0:1789607456.237711:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028160 00000100:00100000:2.0:1789607456.237730:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789607456.237742:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+22:6466:x1876539150028160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.237750:0:6464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607456.237760:0:6464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580200/0xa26202d240fbd8d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd8cd expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237778:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580200/0xa26202d240fbd8d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd8cd expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237788:0:6464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580200/0xa26202d240fbd8d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd8cd expref: 23 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237795:0:6464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580200, rc 0) 00000100:00100000:2.0:1789607456.237823:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150028160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.237829:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789607456.237856:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.237889:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.237898:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607456.237935:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.237959:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.237973:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.237984:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028288 00000100:00100000:2.0:1789607456.237987:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028288 00000100:00100000:2.0:1789607456.238005:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789607456.238018:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150028288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.249497:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150028288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 11472us (11529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.249511:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789607456.250578:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607456.250682:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607456.250732:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607456.250775:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607456.250811:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.250932:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014592 00000100:00100000:2.0:1789607456.250940:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014592 00000100:00100000:2.0:1789607456.250973:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028416 00000100:00100000:2.0:1789607456.250976:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028416 00000100:00100000:2.0:1789607456.250991:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 353 00000100:00100000:2.0:1789607456.250999:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:10896:x1876539130014592:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607456.252455:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:10896:x1876539130014592:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 1448us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.252465:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 353 00000100:00100000:2.0:1789607456.252498:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789607456.252507:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150028416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.252632:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150028416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.252638:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789607456.255916:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.264607:0:13334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13334:1876539150028544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.264685:0:13334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.264721:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028544 00000100:00100000:2.0:1789607456.264727:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028544 00000100:00100000:2.0:1789607456.264772:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789607456.264780:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:13334:x1876539150028544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.265018:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:13334:x1876539150028544:12345-0@lo:502:llog_process_th.0 Request processed in 237us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.265026:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789607456.265083:0:13334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.265104:0:13334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13334:1876539150028544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607456.265127:0:13334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607456.265137:0:13334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.265139:0:13334:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607456.265160:0:13334:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78f05a9800 00000020:00000080:2.0:1789607456.265163:0:13334:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607456.265242:0:13334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607456.265246:0:13334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.265247:0:13334:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607456.265250:0:13334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607456.265253:0:13334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.265254:0:13334:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789607456.265258:0:13334:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78f05a9800 00000020:00000080:2.0:1789607456.265260:0:13334:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607456.265293:0:13334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13334:1876539150028672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.265456:0:13334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.265478:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028672 00000100:00100000:2.0:1789607456.265482:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028672 00000100:00100000:2.0:1789607456.265503:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789607456.265509:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:13334:x1876539150028672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607456.265626:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:13334:x1876539150028672:12345-0@lo:502:llog_process_th.0 Request processed in 117us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.265633:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789607456.265668:0:13334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.265680:0:13334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13334:1876539150028672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607456.265697:0:13334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607456.265700:0:13334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607456.265702:0:13334:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789607456.265706:0:13334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789607456.265751:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789607456.265768:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607456.265777:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.265787:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607456.265798:0:6466:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607456.265800:0:6466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c75d7000 from 7 10000000:01000000:2.0:1789607456.265803:0:6466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607456.265825:0:6466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.265833:0:6466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.265843:0:6466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607456.265856:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607456.265907:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.265924:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607456.265937:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028800 00000100:00100000:2.0:1789607456.265947:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028800 00000100:00100000:2.0:1789607456.265965:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789607456.265971:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+23:6466:x1876539150028800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.265979:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607456.265990:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbd8e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbd8db expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.266010:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbd8e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbd8db expref: 24 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.266020:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbd8e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbd8db expref: 24 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.266027:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580e00, rc 0) 00000100:00100000:2.0:1789607456.266056:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150028800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607456.266061:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789607456.266088:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607456.266099:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607456.266107:0:6466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607456.266143:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607456.268893:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607456.269188:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014720 00000100:00100000:1.0:1789607456.269197:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014720 00000100:00100000:1.0:1789607456.269248:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 358 00000100:00100000:1.0:1789607456.269266:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:6373:x1876539130014720:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607456.269282:0:6462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607456.269305:0:6462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd8e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688a7 expref: -99 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607456.269331:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd8e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688a7 expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607456.269343:0:6462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd8e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688a7 expref: 13 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607456.269351:0:6462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0030c00, rc 0) 00000100:00100000:1.0:1789607456.273369:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130014720:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 4101us (4472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.273382:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 358 00000100:00100000:1.0:1789607456.275589:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607456.275657:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014848 00000100:00100000:3.0:1789607456.275667:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014848 00000100:00100000:3.0:1789607456.275720:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 359 00000100:00100000:3.0:1789607456.275729:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130014848:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607456.276394:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130014848:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 458us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607456.276407:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 359 00000100:00100000:2.0:1789607456.276642:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.276684:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607456.276728:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150028928 00000100:00100000:1.0:1789607456.276734:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150028928 00000100:00100000:1.0:1789607456.276768:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789607456.276776:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150028928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607456.277746:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150028928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 966us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.277756:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789607456.277931:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150028928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.277983:0:6466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150029056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.278026:0:6466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.278053:0:6466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607456.279477:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029056 00000100:00100000:3.0:1789607456.279490:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029056 00000100:00100000:3.0:1789607456.279555:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789607456.279565:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150029056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607456.279770:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:6466:x1876539150029056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607456.279777:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789607456.281600:0:6466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c0415db0-4674-4bfe-9696-a490439e72d4:6466:1876539150029056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.281772:0:13336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13336:1876539150029184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607456.281827:0:13336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.281857:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029184 00000100:00100000:0.0:1789607456.281879:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029184 00000100:00100000:0.0:1789607456.281911:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789607456.281919:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:13336:x1876539150029184:12345-0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789607456.281939:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789607456.282084:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607456.282096:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:13336:x1876539150029184:12345-0@lo:502:llog_process_th.0 Request processed in 178us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607456.282104:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789607456.282105:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130014976 00000100:00100000:1.0:1789607456.282108:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130014976 00000100:00100000:1.0:1789607456.282126:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 363 00000100:00100000:1.0:1789607456.282132:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130014976:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607456.282143:0:13336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607456.282155:0:13336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13336:1876539150029184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607456.282191:0:13336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607456.282200:0:13336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607456.282202:0:13336:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789607456.282209:0:13336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78c75d7000 00000020:00000080:0.0:1789607456.282212:0:13336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789607456.282263:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:6373:x1876539130014976:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 130us (180us total) trans 0 rc 0/0 00000020:01000000:0.0:1789607456.282267:0:13336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607456.282270:0:13336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607456.282272:0:13336:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789607456.282275:0:13336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1789607456.282277:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 363 00000020:00000080:0.0:1789607456.282277:0:13336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607456.282278:0:13336:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789607456.282282:0:13336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78c75d7000 00000020:00000080:0.0:1789607456.282284:0:13336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789607456.282315:0:13336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13336:1876539150029312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607456.282346:0:13336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.282362:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029312 00000100:00100000:0.0:1789607456.282366:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029312 00000100:00100000:0.0:1789607456.282385:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789607456.282390:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:13336:x1876539150029312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607456.282486:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:13336:x1876539150029312:12345-0@lo:502:llog_process_th.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607456.282493:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789607456.282519:0:13336:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607456.282530:0:13336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c0415db0-4674-4bfe-9696-a490439e72d4:13336:1876539150029312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607456.282546:0:13336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607456.282550:0:13336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607456.282551:0:13336:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789607456.282554:0:13336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789607456.282590:0:6466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789607456.282607:0:6466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607456.282615:0:6466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607456.282626:0:6466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607456.287798:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607456.287832:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015104 00000100:00100000:0.0:1789607456.287840:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015104 00000100:00100000:0.0:1789607456.287912:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 365 00000100:00100000:0.0:1789607456.287922:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:10899:x1876539130015104:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607456.288154:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:10899:x1876539130015104:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 232us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607456.288163:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 365 00000100:00100000:2.0:1789607456.292487:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607456.292583:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015232 00000100:00100000:3.0:1789607456.292593:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015232 00000100:00100000:3.0:1789607456.292645:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 366 00000100:00100000:3.0:1789607456.292655:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:10899:x1876539130015232:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607456.292915:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:10899:x1876539130015232:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 250us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607456.292925:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 366 00000040:00080000:0.0:1789607456.318774:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607456.482059:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150029568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607456.482064:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150029440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607456.482123:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607456.482254:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607456.484331:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029440 00000100:00100000:0.0:1789607456.484346:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029440 00000100:00100000:1.0:1789607456.487470:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029568 00000100:00100000:1.0:1789607456.487484:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029568 00000100:00100000:1.0:1789607456.487513:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607456.487523:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150029440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607456.487561:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607456.487647:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150029440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (5523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.487653:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607456.487669:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607456.487675:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150029568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607456.487686:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607456.487717:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150029568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (5463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.487722:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1789607456.487765:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc6300 x1876539150029568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607456.487786:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150029568:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789607456.487821:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c12ea300 x1876539150029440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607456.487834:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150029440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607456.487914:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607456.996432:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607456.996594:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150029696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607456.996663:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607456.997353:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029696 00000100:00100000:1.0:1789607456.997363:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029696 00000100:00100000:1.0:1789607456.997415:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789607456.997439:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150029696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607456.997479:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607456.997543:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150029696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607456.997550:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789607456.997807:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150029696:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789607457.315095:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789607457.380986:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607457.506658:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607457.506681:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150029824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607457.506749:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607457.506932:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029824 00000100:00100000:3.0:1789607457.506942:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029824 00000100:00100000:3.0:1789607457.508105:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789607457.508130:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150029824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607457.508214:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607457.508348:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150029824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 227us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607457.508357:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789607457.508420:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150029824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607458.018285:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607459.042180:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607459.332113:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607459.332178:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607459.332266:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015360 00000100:00100000:3.0:1789607459.332276:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015360 00000100:00100000:3.0:1789607459.332342:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 367 00000100:00100000:3.0:1789607459.332352:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130015360:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607459.332420:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130015360:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607459.332427:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 367 00000100:00100000:0.0:1789607459.332949:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607459.332979:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607459.333066:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015744 00000100:00100000:3.0:1789607459.333071:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015744 00000100:00100000:3.0:1789607459.333120:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:3.0:1789607459.333140:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130015744:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607459.333190:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130015744:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607459.333197:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00080000:1.0:1789607459.333744:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607459.334806:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015488 00000100:00100000:2.0:1789607459.334817:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015488 00000100:00100000:2.0:1789607459.335030:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016000 00000100:00100000:2.0:1789607459.335035:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016000 00000100:00080000:1.0:1789607459.335056:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607459.335060:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607459.335110:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 236 00000100:00100000:3.0:1789607459.335130:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130015488:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607459.335206:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130015488:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 88us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607459.335213:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 236 00000100:00100000:2.0:1789607459.335916:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 237 00000100:00100000:2.0:1789607459.335926:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130016000:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607459.335982:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130016000:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 58us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.335988:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 237 00000100:00100000:3.0:1789607459.337709:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607459.337745:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607459.337770:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015616 00000100:00100000:3.0:1789607459.337790:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015616 00000100:00100000:2.0:1789607459.337844:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130015872 00000100:00100000:2.0:1789607459.337848:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130015872 00000100:00080000:1.0:1789607459.338633:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607459.338639:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607459.338823:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 238 00000100:00100000:3.0:1789607459.338833:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130015616:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607459.338919:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130015616:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 87us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607459.338926:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 238 00000100:00100000:2.0:1789607459.339112:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 239 00000100:00100000:2.0:1789607459.339120:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130015872:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607459.339172:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130015872:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 53us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.339179:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 239 00000100:00100000:3.0:1789607459.555640:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607459.555771:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607459.555791:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150030080:0@lo:400:kworker.0 00000100:00100000:1.0:1789607459.555878:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607459.555979:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150030208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607459.556008:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607459.556054:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030208 00000100:00100000:1.0:1789607459.556060:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030208 00000100:00100000:1.0:1789607459.556108:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607459.556115:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150030208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607459.556169:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607459.556213:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150030208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607459.556220:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607459.556263:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150030208:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789607459.556282:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607459.556717:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030080 00000100:00100000:1.0:1789607459.556723:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030080 00000100:00100000:1.0:1789607459.556769:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789607459.556775:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150030080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607459.556830:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150030080:12345-0@lo:400:kworker.0 Request processed in 55us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607459.556836:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789607459.556940:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150030080:0@lo:400:kworker.0 00000100:00100000:3.0:1789607459.565591:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150029952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607459.565672:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607459.565721:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150029952 00000100:00100000:2.0:1789607459.565729:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150029952 00000100:00100000:2.0:1789607459.567503:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789607459.567516:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150029952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607459.567543:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607459.567607:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150029952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.567614:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789607459.567684:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789607459.567690:0:3469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78efaed180, transno 4294967301 00000100:00100000:2.0:1789607459.567706:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150029952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607459.568875:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150030336:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.568936:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607459.568982:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150030848:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.569007:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607459.569464:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150030592:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.569856:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150031360:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.569958:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607459.569981:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789607459.569988:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150030720:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.570010:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607459.570026:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150031232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.570046:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607459.570072:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030720 00000100:00100000:0.0:1789607459.570079:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030720 00000100:00100000:0.0:1789607459.570120:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607459.570127:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150030720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.570244:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150030720:12345-0@lo:400:kworker.0 Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607459.570251:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607459.570272:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031232 00000100:00100000:0.0:1789607459.570275:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031232 00000100:00100000:2.0:1789607459.570405:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030336 00000100:00100000:2.0:1789607459.570412:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030336 00000100:00100000:2.0:1789607459.570436:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030848 00000100:00100000:2.0:1789607459.570441:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030848 00000100:00100000:1.0:1789607459.570669:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031360 00000100:00100000:1.0:1789607459.570673:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031360 00000100:00100000:2.0:1789607459.572250:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789607459.572263:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150030336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789607459.572416:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607459.572450:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789607459.572459:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150030848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.572623:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789607459.572631:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150031232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.572670:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150031232:12345-0@lo:400:kworker.0 Request processed in 40us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607459.572677:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789607459.572731:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150030720:0@lo:400:kworker.0 00010000:00080000:0.0:1789607459.572747:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0ce00 x1876539150031232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607459.572777:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150031232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607459.572793:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150030336:0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.575267:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150030336:12345-0@lo:400:kworker.0 Request processed in 2994us (6316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.575280:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789607459.575560:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607459.575622:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150031104:0@lo:400:kworker.0 00000100:00100000:3.0:1789607459.575796:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150030848:12345-0@lo:400:kworker.0 Request processed in 3338us (6787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607459.575804:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789607459.575822:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030592 00000100:00100000:3.0:1789607459.575829:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030592 00000100:00100000:3.0:1789607459.575876:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789607459.575884:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150030592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607459.575921:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150030592:12345-0@lo:400:kworker.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607459.575927:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789607459.575976:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150030848:0@lo:400:kworker.0 00000100:00080000:3.0:1789607459.576015:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607459.576020:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607459.576045:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150030464:0@lo:400:kworker.0 00000100:00100000:3.0:1789607459.576086:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607459.576106:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150030976:0@lo:400:kworker.0 00000100:00100000:3.0:1789607459.576127:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607459.576154:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150031488:0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.576723:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607459.576761:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150030592:0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.576796:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030464 00000100:00100000:2.0:1789607459.576801:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030464 00000100:00100000:2.0:1789607459.576829:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789607459.576844:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150030464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.576903:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150030464:12345-0@lo:400:kworker.0 Request processed in 60us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.576908:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789607459.576930:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150030976 00000100:00100000:2.0:1789607459.576933:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150030976 00000100:00100000:2.0:1789607459.576961:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789607459.576966:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.576991:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150030976:12345-0@lo:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.576996:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1789607459.577022:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607459.577042:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031104 00000100:00100000:2.0:1789607459.577045:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031104 00000100:00100000:2.0:1789607459.577070:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789607459.577076:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150031104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.577105:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150031104:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.577110:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1789607459.577138:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0ea00 x1876539150031104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607459.577158:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150031104:0@lo:400:kworker.0 00000100:00080000:2.0:1789607459.577178:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607459.577269:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607459.577308:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150030464:0@lo:400:kworker.0 00010000:00080000:3.0:1789607459.577318:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901377480 x1876539150030976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607459.577326:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150030976:0@lo:400:kworker.0 00000100:00100000:2.0:1789607459.577419:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031488 00000100:00100000:2.0:1789607459.577423:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031488 00000100:00100000:2.0:1789607459.577451:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789607459.577457:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150031488:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789607459.577562:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607459.577637:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150031488:12345-0@lo:400:kworker.0 Request processed in 179us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607459.577644:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:3.0:1789607459.577899:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075ed80 x1876539150031488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607459.577909:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150031488:0@lo:400:kworker.0 00000100:00100000:1.0:1789607459.578225:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789607459.578232:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150031360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607459.578324:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150031360:12345-0@lo:400:kworker.0 Request processed in 93us (8365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607459.578330:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789607459.578612:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150031360:0@lo:400:kworker.0 00010000:00010000:0.0:1789607460.066646:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607461.090378:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607461.606723:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150031616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607461.606789:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607461.607080:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150031744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607461.607108:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607461.607244:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031616 00000100:00100000:3.0:1789607461.607252:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031616 00000100:00100000:3.0:1789607461.607311:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031744 00000100:00100000:3.0:1789607461.607315:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031744 00000100:00100000:3.0:1789607461.607333:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789607461.607341:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150031616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607461.607379:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607461.607423:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150031616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607461.607430:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789607461.607445:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789607461.607451:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150031744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607461.607485:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607461.607517:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150031744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607461.607524:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789607461.607559:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f7571c00 x1876539150031744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607461.607577:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150031744:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789607461.607694:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc6300 x1876539150031616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607461.607707:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150031616:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789607461.607724:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607462.114664:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150031872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607462.114736:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607462.115002:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150031872 00000100:00100000:1.0:1789607462.115011:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150031872 00000100:00100000:1.0:1789607462.115058:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789607462.115068:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150031872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607462.115116:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607462.115191:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150031872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607462.115197:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789607462.115410:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150031872:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789607462.118710:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607462.626773:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607462.626796:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150032000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607462.626881:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607462.627010:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032000 00000100:00100000:3.0:1789607462.627017:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032000 00000100:00100000:3.0:1789607462.627064:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789607462.627073:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150032000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607462.627110:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607462.627176:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150032000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607462.627183:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789607462.627264:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150032000:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607463.138294:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607464.163214:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607464.458762:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607464.458809:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607464.458854:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607464.459013:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016128 00000100:00100000:1.0:1789607464.459022:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016128 00000100:00100000:1.0:1789607464.459073:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 369 00000100:00100000:1.0:1789607464.459083:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130016128:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607464.459124:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016256 00000100:00100000:0.0:1789607464.459128:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016256 00000100:00100000:1.0:1789607464.459161:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130016128:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 79us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607464.459168:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00100000:0.0:1789607464.459175:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130016256:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607464.459179:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 369 00000100:00100000:0.0:1789607464.459204:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130016256:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607464.459210:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00080000:1.0:1789607464.459226:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607464.459282:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016512 00000100:00100000:3.0:1789607464.459287:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016512 00000100:00100000:3.0:1789607464.459342:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:3.0:1789607464.459350:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130016512:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607464.459378:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130016512:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607464.459384:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00080000:1.0:1789607464.459554:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607464.460074:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607464.460175:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607464.460274:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607464.469052:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016768 00000100:00100000:1.0:1789607464.469067:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016768 00000100:00100000:1.0:1789607464.469279:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016384 00000100:00100000:1.0:1789607464.469295:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016384 00000100:00100000:3.0:1789607464.470995:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016640 00000100:00100000:3.0:1789607464.471007:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016640 00000100:00100000:0.0:1789607464.471377:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00100000:0.0:1789607464.471394:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130016768:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607464.471490:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130016768:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 102us (11417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607464.471497:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00080000:2.0:1789607464.472318:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607464.472327:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607464.472539:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00100000:1.0:1789607464.472551:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130016384:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607464.472612:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130016384:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 63us (12437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607464.472619:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00100000:3.0:1789607464.472823:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00100000:3.0:1789607464.472831:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130016640:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607464.472894:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130016640:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 63us (12619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607464.472913:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00100000:0.0:1789607464.674150:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150032512:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674179:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150032256:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.674267:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150032128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607464.674344:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674390:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150032768:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674416:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674438:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674478:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674498:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150033792:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674518:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674542:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789607464.674549:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150032384:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674573:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674592:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150032896:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674612:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674630:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150033408:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.674651:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607464.674680:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032256 00000100:00100000:2.0:1789607464.674688:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032256 00000100:00100000:2.0:1789607464.674732:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789607464.674740:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150032256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607464.675708:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032384 00000100:00100000:1.0:1789607464.675715:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032384 00000100:00100000:1.0:1789607464.675747:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032896 00000100:00100000:1.0:1789607464.675750:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032896 00000100:00100000:1.0:1789607464.675790:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033408 00000100:00100000:1.0:1789607464.675793:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033408 00000100:00100000:1.0:1789607464.675813:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789607464.675820:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150032384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607464.675907:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150032384:12345-0@lo:400:kworker.0 Request processed in 87us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607464.675914:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789607464.675933:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789607464.675939:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150032896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676217:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150032256:12345-0@lo:400:kworker.0 Request processed in 1477us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607464.676225:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789607464.676256:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032768 00000100:00100000:2.0:1789607464.676260:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032768 00000100:00100000:2.0:1789607464.676299:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789607464.676306:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150032768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676350:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150032768:12345-0@lo:400:kworker.0 Request processed in 45us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607464.676357:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789607464.676374:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033280 00000100:00100000:2.0:1789607464.676377:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033280 00000100:00100000:2.0:1789607464.676399:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033792 00000100:00100000:2.0:1789607464.676401:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033792 00000100:00100000:2.0:1789607464.676421:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789607464.676427:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150033280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676459:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150033280:12345-0@lo:400:kworker.0 Request processed in 32us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607464.676465:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789607464.676476:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789607464.676482:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676510:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150033792:12345-0@lo:400:kworker.0 Request processed in 29us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607464.676515:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789607464.676556:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150032384:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676567:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150032256:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676576:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150032768:0@lo:400:kworker.0 00010000:00080000:2.0:1789607464.676589:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e2680 x1876539150033280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607464.676598:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676607:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150033792:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.676637:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607464.676650:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150033920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607464.676679:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607464.676706:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607464.676711:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607464.676713:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607464.676741:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789607464.676748:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150033408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607464.680250:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150032896:12345-0@lo:400:kworker.0 Request processed in 4304us (5629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607464.680280:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789607464.681832:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150033408:12345-0@lo:400:kworker.0 Request processed in 5079us (7174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607464.681842:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789607464.681911:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150032896:0@lo:400:kworker.0 00000100:00100000:1.0:1789607464.681925:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150033408:0@lo:400:kworker.0 00000100:00100000:2.0:1789607464.686238:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033920 00000100:00100000:2.0:1789607464.686252:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033920 00000100:00100000:2.0:1789607464.686331:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607464.686342:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150033920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607464.686399:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607464.686495:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150033920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (9814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607464.686503:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789607464.686524:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607464.686881:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150033920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607464.687836:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607464.687995:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150033024:0@lo:400:kworker.0 00000100:00100000:0.0:1789607464.688037:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607464.688065:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033024 00000100:00100000:0.0:1789607464.688072:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033024 00000100:00100000:0.0:1789607464.688136:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789607464.688145:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150033024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607464.688190:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150033024:12345-0@lo:400:kworker.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607464.688196:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:0.0:1789607464.688220:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789607464.688241:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0702d80 x1876539150033024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607464.688254:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150033024:0@lo:400:kworker.0 00000100:00100000:0.0:1789607464.688262:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150033536:0@lo:400:kworker.0 00000100:00100000:0.0:1789607464.688284:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607464.688306:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033536 00000100:00100000:0.0:1789607464.688310:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033536 00000100:00100000:0.0:1789607464.688337:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789607464.688342:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150033536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607464.688371:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150033536:12345-0@lo:400:kworker.0 Request processed in 28us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607464.688377:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:0.0:1789607464.688391:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789607464.688406:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0380 x1876539150033536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607464.688431:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150033536:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.689659:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607464.689692:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032128 00000100:00100000:3.0:1789607464.689698:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032128 00000100:00100000:3.0:1789607464.689731:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789607464.689739:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150032128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607464.689761:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607464.689803:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150032128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607464.689810:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789607464.689882:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c6580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150032128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607464.689892:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150032640:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.689919:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607464.689940:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032640 00000100:00100000:3.0:1789607464.689943:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032640 00000100:00100000:3.0:1789607464.690353:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789607464.690359:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150032640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690395:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150032640:12345-0@lo:400:kworker.0 Request processed in 36us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607464.690401:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789607464.690432:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150032640:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690439:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150033152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690479:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607464.690502:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033152 00000100:00100000:3.0:1789607464.690507:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033152 00000100:00100000:3.0:1789607464.690542:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789607464.690548:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150033152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690580:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150033152:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607464.690586:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1789607464.690604:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607464.690621:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703800 x1876539150033152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607464.690631:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150033152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690638:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150033664:0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690661:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607464.690682:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150033664 00000100:00100000:3.0:1789607464.690685:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150033664 00000100:00100000:3.0:1789607464.690708:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607464.690714:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150033664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607464.690742:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150033664:12345-0@lo:400:kworker.0 Request processed in 28us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607464.690747:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607464.690772:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150033664:0@lo:400:kworker.0 00000100:00100000:1.0:1789607464.692243:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150032512 00000100:00100000:1.0:1789607464.692254:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150032512 00000100:00100000:1.0:1789607464.692312:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789607464.692321:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150032512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607464.692404:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150032512:12345-0@lo:400:kworker.0 Request processed in 84us (4582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607464.692411:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789607464.693790:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150032512:0@lo:400:kworker.0 00010000:00010000:0.0:1789607465.186264:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607466.210035:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607466.723559:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150034048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607466.723633:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607466.723846:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034048 00000100:00100000:3.0:1789607466.723855:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034048 00000100:00100000:3.0:1789607466.723934:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789607466.723943:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150034048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607466.723989:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607466.724035:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150034048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607466.724043:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1789607466.725239:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607466.725284:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fff0ea00 x1876539150034048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607466.725307:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150034048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607466.725661:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607466.725674:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150034176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607466.725725:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607466.727390:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034176 00000100:00100000:2.0:1789607466.727403:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034176 00000100:00100000:2.0:1789607466.727480:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607466.727490:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150034176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607466.727514:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789607466.727558:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607466.727591:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150034176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1866us total) trans 0 rc 0/0 00010000:00080000:0.0:1789607466.727596:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc4e00 x1876539150034176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607466.727598:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607466.727613:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150034176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607467.234125:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150034304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607467.234200:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607467.234261:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034304 00000100:00100000:3.0:1789607467.234270:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034304 00010000:00010000:0.0:1789607467.234302:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607467.234324:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789607467.234334:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150034304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607467.234371:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607467.235942:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150034304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607467.235994:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150034304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1591us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607467.236005:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000040:00080000:3.0:1789607467.554519:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789607467.682572:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607467.747395:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150034432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607467.747529:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607467.747700:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034432 00000100:00100000:2.0:1789607467.747709:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034432 00000100:00100000:2.0:1789607467.747763:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789607467.747772:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150034432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607467.747809:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607467.747885:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150034432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607467.747892:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607467.748041:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fff0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150034432:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607468.258068:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607469.282096:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607469.574647:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607469.574689:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607469.574745:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607469.574778:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017152 00000100:00100000:0.0:1789607469.574787:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017152 00000100:00100000:0.0:1789607469.574843:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017024 00000100:00100000:0.0:1789607469.574846:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017024 00000100:00100000:0.0:1789607469.574899:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 256 00000100:00100000:0.0:1789607469.574911:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130017152:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607469.574983:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130017152:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 75us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.574991:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 256 00000100:00100000:0.0:1789607469.575008:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 257 00000100:00100000:0.0:1789607469.575014:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130017024:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607469.575041:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130017024:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.575047:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 257 00000100:00080000:2.0:1789607469.575346:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607469.575350:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607469.577004:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130016896 00000100:00100000:1.0:1789607469.577016:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130016896 00000100:00100000:1.0:1789607469.577084:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 371 00000100:00100000:1.0:1789607469.577094:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130016896:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607469.577182:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130016896:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 78us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607469.577202:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 371 00000100:00100000:0.0:1789607469.581852:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607469.581918:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607469.581951:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607469.582036:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017408 00000100:00100000:2.0:1789607469.582047:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017408 00000100:00100000:2.0:1789607469.582128:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017536 00000100:00100000:2.0:1789607469.582132:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017536 00000100:00100000:2.0:1789607469.582156:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 258 00000100:00100000:2.0:1789607469.582167:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130017408:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607469.582467:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130017408:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 301us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607469.582476:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 258 00000100:00100000:2.0:1789607469.582495:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 259 00000100:00100000:2.0:1789607469.582502:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130017536:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607469.582529:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130017536:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607469.582535:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 259 00000100:00080000:0.0:1789607469.583758:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607469.583764:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607469.584092:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017280 00000100:00100000:1.0:1789607469.584102:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017280 00000100:00100000:3.0:1789607469.584459:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1789607469.584470:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2392:x1876539130017280:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:3.0:1789607469.584497:0:8112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd810 00000100:00080000:3.0:1789607469.584506:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d78cfc3d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607469.584555:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1789607469.584810:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+2:2392:x1876539130017280:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 342us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607469.584818:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00080000:0.0:1789607469.585129:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789607469.585340:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607469.794820:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607469.794841:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150034560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607469.794924:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796195:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150034688:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796263:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796318:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150035200:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796345:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796369:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150035712:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796393:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796415:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789607469.796421:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150035072:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796446:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796466:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150035584:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796485:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796505:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150036096:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796524:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607469.796554:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035712 00000100:00100000:0.0:1789607469.796561:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035712 00000100:00100000:0.0:1789607469.796611:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035584 00000100:00100000:0.0:1789607469.796614:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035584 00000100:00100000:0.0:1789607469.796633:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036096 00000100:00100000:0.0:1789607469.796636:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036096 00000100:00100000:0.0:1789607469.796653:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789607469.796662:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150035712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796714:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150035712:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.796721:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789607469.796738:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789607469.796744:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150035584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796770:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150035584:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.796776:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789607469.796797:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789607469.796803:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150036096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796833:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150036096:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.796839:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789607469.796855:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035072 00000100:00100000:0.0:1789607469.796858:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035072 00000100:00100000:0.0:1789607469.796911:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789607469.796918:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150035072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.796948:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150035072:12345-0@lo:400:kworker.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.796954:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:0.0:1789607469.796970:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607469.796975:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607469.796984:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035200 00000100:00100000:0.0:1789607469.796987:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035200 00000100:00100000:0.0:1789607469.797013:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607469.797019:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150035200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.797236:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034688 00000100:00100000:2.0:1789607469.797241:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034688 00000100:00100000:2.0:1789607469.797273:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789607469.797280:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150034688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.797384:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150035200:12345-0@lo:400:kworker.0 Request processed in 365us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.797390:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789607469.797975:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034560 00000100:00100000:1.0:1789607469.797981:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034560 00000100:00100000:1.0:1789607469.798017:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607469.798023:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150034560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607469.798060:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607469.799411:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150034944:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.807786:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150035072:0@lo:400:kworker.0 00000100:00080000:0.0:1789607469.807812:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789607469.807834:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffad880 x1876539150035584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607469.807844:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150035584:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.807887:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150036096:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.807899:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150035200:0@lo:400:kworker.0 00010000:00080000:0.0:1789607469.807909:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffaea00 x1876539150035712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607469.807917:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150035712:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.807953:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150036224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607469.808012:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607469.808574:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150034688:12345-0@lo:400:kworker.0 Request processed in 11292us (12308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607469.808584:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789607469.808645:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150034816:0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.808677:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607469.808699:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150035328:0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.808717:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607469.808730:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150035840:0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.808746:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607469.808772:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034816 00000100:00100000:2.0:1789607469.808778:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034816 00000100:00100000:2.0:1789607469.809274:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035328 00000100:00100000:2.0:1789607469.809279:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035328 00000100:00100000:2.0:1789607469.809309:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035840 00000100:00100000:2.0:1789607469.809312:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035840 00000100:00100000:2.0:1789607469.809329:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789607469.809336:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150034816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.809393:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150034816:12345-0@lo:400:kworker.0 Request processed in 57us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607469.809400:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789607469.809413:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789607469.809419:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150035328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.809443:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150035328:12345-0@lo:400:kworker.0 Request processed in 25us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607469.809458:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789607469.809468:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789607469.809473:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150035840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607469.809501:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150035840:12345-0@lo:400:kworker.0 Request processed in 28us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607469.809506:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789607469.809902:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150034560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11877us (14976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607469.809910:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607469.809925:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036224 00000100:00100000:1.0:1789607469.809929:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036224 00000100:00100000:1.0:1789607469.809956:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789607469.809962:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150036224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607469.809979:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607469.810012:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150036224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607469.810017:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1789607469.810066:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607469.810111:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150036224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607469.810122:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150034688:0@lo:400:kworker.0 00000100:00100000:1.0:1789607469.810134:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150034560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607469.823625:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607469.823683:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150035456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607469.823717:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607469.823764:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150035968:0@lo:400:kworker.0 00000100:00100000:3.0:1789607469.823787:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607469.823897:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150034816:0@lo:400:kworker.0 00000100:00100000:3.0:1789607469.823910:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150035328:0@lo:400:kworker.0 00000100:00100000:3.0:1789607469.823920:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150035840:0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.824125:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150034944 00000100:00100000:0.0:1789607469.824132:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150034944 00000100:00100000:0.0:1789607469.824183:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789607469.824192:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150034944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607469.824261:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150034944:12345-0@lo:400:kworker.0 Request processed in 70us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607469.824268:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789607469.824299:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150034944:0@lo:400:kworker.0 00000100:00100000:1.0:1789607469.824495:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035456 00000100:00100000:1.0:1789607469.824500:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035456 00000100:00100000:1.0:1789607469.824553:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150035968 00000100:00100000:1.0:1789607469.824557:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150035968 00000100:00100000:1.0:1789607469.824576:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789607469.824583:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150035456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607469.824626:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150035456:12345-0@lo:400:kworker.0 Request processed in 44us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607469.824631:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789607469.824645:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789607469.824651:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607469.824678:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150035968:12345-0@lo:400:kworker.0 Request processed in 29us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607469.824683:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1789607469.824753:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789607469.824778:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7df80 x1876539150035456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607469.824788:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150035456:0@lo:400:kworker.0 00010000:00080000:0.0:1789607469.824797:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffae680 x1876539150035968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607469.824804:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150035968:0@lo:400:kworker.0 00000001:00100000:2.0:1789607469.892926:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:2.0:1789607469.892936:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d78cfc3e800/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:0.0:1789607469.892997:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78cfc3e800/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-OST0001 00000020:00000080:0.0:1789607469.893060:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78cfc3d800 for lustre-OST0001 00010000:00010000:0.0:1789607470.309763:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607471.330033:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607471.842208:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607471.842231:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150036352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607471.842296:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607471.842408:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036352 00000100:00100000:1.0:1789607471.842416:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036352 00000100:00100000:1.0:1789607471.842477:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789607471.842487:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150036352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607471.842521:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607471.842570:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150036352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607471.842577:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789607471.842643:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607471.842673:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc6300 x1876539150036352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607471.842691:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150036352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607471.843156:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150036480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607471.843187:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607471.843211:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036480 00000100:00100000:0.0:1789607471.843214:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036480 00000100:00100000:0.0:1789607471.843247:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789607471.843254:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150036480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607471.843266:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607471.843293:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150036480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607471.843300:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1789607471.843315:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607471.843334:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efea00 x1876539150036480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607471.843346:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150036480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607472.354412:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607472.354437:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150036608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607472.354524:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607472.354716:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036608 00000100:00100000:2.0:1789607472.354724:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036608 00000100:00100000:2.0:1789607472.354777:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789607472.354787:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150036608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607472.354825:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789607472.354893:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150036608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607472.354900:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789607472.355076:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150036608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789607472.355453:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607472.866736:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150036736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607472.866808:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607472.866954:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036736 00000100:00100000:3.0:1789607472.866963:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036736 00000100:00100000:3.0:1789607472.867009:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789607472.867018:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150036736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607472.867075:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607472.867140:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150036736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607472.867147:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607472.867475:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150036736:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607473.380270:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607474.409043:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607474.691412:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607474.691517:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017664 00000100:00100000:2.0:1789607474.691527:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017664 00000100:00100000:2.0:1789607474.691586:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 373 00000100:00100000:2.0:1789607474.691597:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130017664:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607474.691677:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130017664:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.691702:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 373 00000100:00100000:3.0:1789607474.700192:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607474.700394:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017792 00000100:00100000:1.0:1789607474.700404:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017792 00000100:00100000:1.0:1789607474.700485:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 266 00000100:00100000:1.0:1789607474.700496:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130017792:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607474.700581:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130017792:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 86us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.700588:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 266 00000100:00080000:0.0:1789607474.701501:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607474.717628:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607474.717743:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607474.718271:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018048 00000100:00100000:2.0:1789607474.718281:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018048 00000100:00100000:2.0:1789607474.718350:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130017920 00000100:00100000:2.0:1789607474.718353:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130017920 00000100:00100000:2.0:1789607474.718376:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 267 00000100:00100000:2.0:1789607474.718385:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130018048:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607474.718454:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130018048:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 70us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.718461:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 267 00000100:00100000:2.0:1789607474.718480:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 268 00000100:00100000:2.0:1789607474.718486:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130017920:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607474.718511:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130017920:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.718517:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 268 00000100:00080000:0.0:1789607474.718665:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607474.718670:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607474.724289:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607474.724365:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018176 00000100:00100000:2.0:1789607474.724375:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018176 00000100:00100000:2.0:1789607474.724447:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 269 00000100:00100000:2.0:1789607474.724459:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130018176:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607474.724540:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130018176:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.724547:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 269 00000100:00080000:0.0:1789607474.724608:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607474.914262:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150037248:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914336:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607474.914412:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150037760:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914437:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607474.914456:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150038272:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914477:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607474.914501:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789607474.914506:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150037120:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914546:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607474.914563:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150037632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914581:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607474.914595:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150038144:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914614:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607474.914646:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037760 00000100:00100000:2.0:1789607474.914654:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037760 00000100:00100000:2.0:1789607474.914700:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038272 00000100:00100000:2.0:1789607474.914703:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038272 00000100:00100000:2.0:1789607474.914717:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037120 00000100:00100000:2.0:1789607474.914720:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037120 00000100:00100000:2.0:1789607474.914729:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037632 00000100:00100000:2.0:1789607474.914731:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037632 00000100:00100000:2.0:1789607474.914741:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038144 00000100:00100000:2.0:1789607474.914743:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038144 00000100:00100000:2.0:1789607474.914756:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789607474.914763:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150037760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914813:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150037760:12345-0@lo:400:kworker.0 Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.914821:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789607474.914835:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789607474.914842:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150038272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914902:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150038272:12345-0@lo:400:kworker.0 Request processed in 61us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.914908:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789607474.914920:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789607474.914926:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150037120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.914953:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150037120:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.914970:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789607474.914981:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789607474.914987:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150037632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.915013:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150037632:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.915019:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789607474.915039:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789607474.915046:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150038144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.915073:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150038144:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.915077:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789607474.915100:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037248 00000100:00100000:2.0:1789607474.915103:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037248 00000100:00100000:2.0:1789607474.915126:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789607474.915132:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150037248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.915163:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150037248:12345-0@lo:400:kworker.0 Request processed in 32us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607474.915168:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1789607474.915190:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607474.915194:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607474.915223:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150037120:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.915234:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150037632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.915243:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150038144:0@lo:400:kworker.0 00000100:00100000:2.0:1789607474.915251:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150037248:0@lo:400:kworker.0 00010000:00080000:2.0:1789607474.915262:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416f800 x1876539150037760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607474.915272:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150037760:0@lo:400:kworker.0 00010000:00080000:2.0:1789607474.915281:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facbf800 x1876539150038272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607474.915288:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150038272:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.915837:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150036864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607474.915909:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.915945:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150037376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.915970:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.915988:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150037888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.916009:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.916023:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150038400:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.916051:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.916067:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789607474.916073:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150036992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.916095:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.916117:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150037504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.916138:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.916157:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150038016:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.916179:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607474.922871:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037888 00000100:00100000:0.0:1789607474.922885:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037888 00000100:00100000:1.0:1789607474.922904:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036864 00000100:00100000:1.0:1789607474.922912:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036864 00000100:00100000:1.0:1789607474.922962:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789607474.922973:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150036864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607474.923012:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607474.923082:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150036864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (7172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.923089:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789607474.923117:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037504 00000100:00100000:1.0:1789607474.923133:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037504 00000100:00100000:1.0:1789607474.923163:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789607474.923170:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150037504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.923222:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150037504:12345-0@lo:400:kworker.0 Request processed in 53us (7083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.923228:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789607474.923255:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150038656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607474.923292:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.923344:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150037376 00000100:00100000:1.0:1789607474.923349:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150037376 00000100:00100000:1.0:1789607474.923377:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789607474.923384:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.923422:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150037376:12345-0@lo:400:kworker.0 Request processed in 34us (7446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.923428:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789607474.923450:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150038528:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.923475:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607474.935597:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150036864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607474.935617:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150037376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.935650:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150037504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.935697:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038656 00000100:00100000:1.0:1789607474.935703:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038656 00000100:00100000:1.0:1789607474.935755:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789607474.935764:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150038656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607474.935787:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607474.935883:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150038656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (12587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.935890:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789607474.935915:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038400 00000100:00100000:1.0:1789607474.935918:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038400 00000100:00100000:1.0:1789607474.935935:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038016 00000100:00100000:1.0:1789607474.935937:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038016 00000100:00100000:1.0:1789607474.935949:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038528 00000100:00100000:1.0:1789607474.935952:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038528 00000100:00100000:1.0:1789607474.935978:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607474.935984:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936044:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150037888:12345-0@lo:400:kworker.0 Request processed in 59us (20033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.936050:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607474.936063:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607474.936068:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936097:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150038400:12345-0@lo:400:kworker.0 Request processed in 29us (20046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.936102:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607474.936112:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789607474.936116:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936141:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150038016:12345-0@lo:400:kworker.0 Request processed in 25us (19963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.936160:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789607474.936171:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789607474.936177:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150038528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936207:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150038528:12345-0@lo:400:kworker.0 Request processed in 30us (12730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.936219:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789607474.936259:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150038656:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789607474.936292:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416d180 x1876539150038016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607474.936302:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150038016:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936312:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150038528:0@lo:400:kworker.0 00010000:00080000:1.0:1789607474.936322:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c416c380 x1876539150037888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607474.936329:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150037888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936338:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150038400:0@lo:400:kworker.0 00000100:00080000:1.0:1789607474.936393:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607474.936397:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607474.936412:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150036992 00000100:00100000:1.0:1789607474.936415:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150036992 00000100:00100000:1.0:1789607474.936441:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789607474.936449:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150036992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607474.936484:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150036992:12345-0@lo:400:kworker.0 Request processed in 37us (20388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607474.936490:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789607474.936534:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150036992:0@lo:400:kworker.0 00010000:00010000:2.0:1789607475.436781:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607476.453427:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607476.972314:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150038784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607476.972377:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607476.972443:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038784 00000100:00100000:0.0:1789607476.972450:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038784 00000100:00100000:0.0:1789607476.972501:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789607476.972511:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150038784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607476.972541:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607476.972757:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150038784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 248us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607476.972765:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789607476.972788:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607476.972819:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703800 x1876539150038784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607476.972836:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150038784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607476.973091:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607476.973101:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150038912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607476.973132:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607476.973703:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150038912 00000100:00100000:2.0:1789607476.973712:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150038912 00000100:00100000:2.0:1789607476.973763:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789607476.973771:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150038912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607476.973786:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607476.973828:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150038912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607476.973835:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:2.0:1789607476.973890:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facbf800 x1876539150038912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607476.973903:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150038912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607476.973957:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607477.474439:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607477.474464:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150039040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607477.474529:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607477.474592:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039040 00000100:00100000:0.0:1789607477.474599:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039040 00000100:00100000:0.0:1789607477.474645:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789607477.474653:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150039040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607477.475284:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607477.475349:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150039040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 695us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607477.475358:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789607477.475412:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150039040:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789607477.477561:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607477.797525:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789607477.924148:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607477.988473:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150039168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607477.988541:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607477.993667:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039168 00000100:00100000:3.0:1789607477.993683:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039168 00000100:00100000:3.0:1789607477.994001:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789607477.994023:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150039168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607477.994073:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607477.994162:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150039168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (5622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607477.994248:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150039168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607477.998079:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00010000:2.0:1789607478.499936:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607479.528423:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607479.827557:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607479.827605:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607479.827647:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607479.827667:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607479.827688:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607479.827713:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018304 00000100:00100000:3.0:1789607479.827723:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018304 00000100:00100000:3.0:1789607479.827771:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 375 00000100:00100000:3.0:1789607479.827781:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130018304:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607479.827967:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018432 00000100:00100000:2.0:1789607479.827972:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018432 00000100:00100000:2.0:1789607479.828017:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018560 00000100:00100000:2.0:1789607479.828021:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018560 00000100:00100000:3.0:1789607479.828027:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130018304:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 246us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607479.828035:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 375 00000100:00100000:3.0:1789607479.828067:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018816 00000100:00100000:3.0:1789607479.828070:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018816 00000100:00100000:2.0:1789607479.829576:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018688 00000100:00100000:2.0:1789607479.829586:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018688 00000100:00100000:3.0:1789607479.831484:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 276 00000100:00100000:3.0:1789607479.831503:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130018432:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607479.831582:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130018432:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 87us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607479.831590:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 276 00000100:00100000:3.0:1789607479.831609:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 277 00000100:00100000:3.0:1789607479.831616:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130018560:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607479.831643:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130018560:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (3995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607479.831649:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 277 00000100:00100000:3.0:1789607479.831660:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 278 00000100:00100000:3.0:1789607479.831667:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130018816:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607479.831689:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130018816:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 23us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607479.831707:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 278 00000100:00100000:2.0:1789607479.839030:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 279 00000100:00100000:2.0:1789607479.839050:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130018688:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607479.839124:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130018688:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 83us (11435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607479.839131:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 279 00000100:00080000:2.0:1789607479.839157:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607479.839161:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607480.036196:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150039680:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036261:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036306:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150040192:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036331:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036359:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150040704:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036380:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036406:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789607480.036411:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150039296:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036436:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036456:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150039808:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036478:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036492:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150040320:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036511:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036527:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150040832:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036544:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036569:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150039552:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036591:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036606:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150040064:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036645:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036663:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150040576:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036684:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.036700:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789607480.036713:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150039424:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.036737:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607480.038094:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150040960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607480.038164:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.038399:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150039936:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.038426:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607480.042344:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150040448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.042408:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607480.042489:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039680 00000100:00100000:0.0:1789607480.042497:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039680 00000100:00100000:0.0:1789607480.042605:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040064 00000100:00100000:0.0:1789607480.042609:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040064 00000100:00100000:0.0:1789607480.042632:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040576 00000100:00100000:0.0:1789607480.042635:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040576 00000100:00100000:0.0:1789607480.042646:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039424 00000100:00100000:0.0:1789607480.042649:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039424 00000100:00100000:0.0:1789607480.042673:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039936 00000100:00100000:0.0:1789607480.042676:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039936 00000100:00100000:0.0:1789607480.042693:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789607480.042701:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150039680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.042780:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150039680:12345-0@lo:400:kworker.0 Request processed in 79us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.042786:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789607480.042803:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789607480.042809:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150040064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.042839:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150040064:12345-0@lo:400:kworker.0 Request processed in 30us (6194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.042844:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789607480.042855:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789607480.042874:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150040576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.042902:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150040576:12345-0@lo:400:kworker.0 Request processed in 42us (6217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.042908:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789607480.042933:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789607480.042939:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150039424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.042966:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150039424:12345-0@lo:400:kworker.0 Request processed in 28us (6227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.042971:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789607480.042981:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789607480.042987:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150039936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.043022:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150039936:12345-0@lo:400:kworker.0 Request processed in 36us (4595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.043034:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789607480.043054:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039808 00000100:00100000:0.0:1789607480.043059:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039808 00000100:00100000:0.0:1789607480.043083:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039552 00000100:00100000:0.0:1789607480.043086:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039552 00000100:00100000:0.0:1789607480.043100:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789607480.043105:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150039808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.043138:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150039808:12345-0@lo:400:kworker.0 Request processed in 33us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.043144:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789607480.043167:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789607480.045429:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150039552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.045511:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150039552:12345-0@lo:400:kworker.0 Request processed in 95us (8918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.045518:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789607480.045658:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040960 00000100:00100000:0.0:1789607480.045665:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040960 00000100:00100000:0.0:1789607480.045708:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789607480.045715:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150040960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607480.045765:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607480.045800:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150040960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (7635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.045806:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789607480.045839:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607480.045843:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607480.045846:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607480.045895:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150039808:0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.045932:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150039680:0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.046071:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150040960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607480.046085:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607480.046094:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150041088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607480.046128:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607480.048459:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040192 00000100:00100000:0.0:1789607480.048474:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040192 00000100:00100000:0.0:1789607480.048526:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040704 00000100:00100000:0.0:1789607480.048530:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040704 00000100:00100000:0.0:1789607480.048541:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040320 00000100:00100000:0.0:1789607480.048543:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040320 00000100:00100000:0.0:1789607480.048554:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040832 00000100:00100000:0.0:1789607480.048557:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040832 00000100:00100000:0.0:1789607480.048573:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789607480.048582:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150040192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.048663:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150040192:12345-0@lo:400:kworker.0 Request processed in 82us (12330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.048670:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789607480.048686:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789607480.048692:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150040704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.048734:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150040704:12345-0@lo:400:kworker.0 Request processed in 29us (12340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.049056:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789607480.049072:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607480.049078:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150040320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.049111:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150040320:12345-0@lo:400:kworker.0 Request processed in 33us (12599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.049122:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607480.049134:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607480.049140:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150040832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.049294:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150040832:12345-0@lo:400:kworker.0 Request processed in 154us (12748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.049301:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607480.049327:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150039296 00000100:00100000:0.0:1789607480.049332:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150039296 00000100:00100000:0.0:1789607480.049359:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789607480.049365:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150039296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.049395:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150039296:12345-0@lo:400:kworker.0 Request processed in 31us (12958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607480.049401:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:0.0:1789607480.049437:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607480.049441:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607480.049469:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150039296:0@lo:400:kworker.0 00010000:00080000:0.0:1789607480.049485:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5127b80 x1876539150040320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607480.049497:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150040320:0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.049508:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150040832:0@lo:400:kworker.0 00010000:00080000:0.0:1789607480.049521:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5124700 x1876539150040192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607480.049528:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150040192:0@lo:400:kworker.0 00000100:00100000:0.0:1789607480.049538:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150040704:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.049910:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150040448 00000100:00100000:3.0:1789607480.049916:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150040448 00000100:00100000:3.0:1789607480.049952:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789607480.049959:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150040448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.050071:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150040448:12345-0@lo:400:kworker.0 Request processed in 112us (7662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607480.050077:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789607480.051284:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041088 00000100:00100000:2.0:1789607480.051295:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041088 00000100:00100000:2.0:1789607480.051338:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607480.051346:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150041088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607480.051365:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607480.051425:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150041088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607480.051431:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607480.051481:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150041088:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789607480.052095:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607480.052124:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150040448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.052137:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150039552:0@lo:400:kworker.0 00010000:00080000:3.0:1789607480.052161:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5124a80 x1876539150040064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607480.052821:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150040064:0@lo:400:kworker.0 00010000:00080000:3.0:1789607480.052843:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c5125880 x1876539150040576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607480.052853:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150040576:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.052917:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150039424:0@lo:400:kworker.0 00000100:00100000:3.0:1789607480.052942:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150039936:0@lo:400:kworker.0 00010000:00010000:0.0:1789607480.546728:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607481.570100:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607481.932023:0:13599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:11:21 (1789607481) 00000100:00100000:0.0:1789607482.087398:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607482.087440:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150041216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607482.087537:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607482.087627:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041216 00000100:00100000:0.0:1789607482.087638:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041216 00000100:00100000:0.0:1789607482.087711:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789607482.087723:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150041216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607482.087789:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607482.087845:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150041216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607482.087853:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1789607482.087936:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f77d3100 x1876539150041216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607482.087960:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150041216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789607482.088091:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607482.088488:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607482.088512:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150041344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607482.088557:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607482.088803:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041344 00000100:00100000:0.0:1789607482.088811:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041344 00000100:00100000:0.0:1789607482.089068:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789607482.089079:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150041344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607482.089104:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607482.089153:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150041344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607482.089160:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1789607482.089328:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607482.089407:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fc905180 x1876539150041344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607482.089428:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150041344:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789607482.594372:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607482.594645:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150041472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607482.594752:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607482.595044:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041472 00000100:00100000:0.0:1789607482.595054:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041472 00000100:00100000:0.0:1789607482.595121:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789607482.595151:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150041472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607482.595223:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607482.595298:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150041472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607482.595305:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789607482.595567:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150041472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607483.106273:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607483.106308:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150041600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607483.106423:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607483.106741:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041600 00000100:00100000:3.0:1789607483.106752:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041600 00000100:00100000:3.0:1789607483.106821:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789607483.106833:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150041600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607483.106911:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607483.106995:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150041600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607483.107004:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789607483.107151:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150041600:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607483.621386:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607483.863563:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607483.863745:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130018944 00000100:00100000:1.0:1789607483.863758:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130018944 00000100:00100000:1.0:1789607483.863857:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:1.0:1789607483.863923:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:11191:x1876539130018944:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607483.863960:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607483.864001:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbd8f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688ae expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607483.864102:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd8f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607483.864119:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607483.864135:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607483.864181:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607483.864186:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607483.864234:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607483.864263:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbd8f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ae expref: 7 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607483.864308:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ae expref: 6 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607483.864317:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:1.0:1789607483.864320:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607483.864324:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031200, rc 0) 00000100:00100000:1.0:1789607483.864415:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:11191:x1876539130018944:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 495us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607483.864422:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00080000:3.0:1789607483.865617:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607483.880295:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607483.881826:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019072 00000100:00100000:0.0:1789607483.881845:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019072 00000100:00100000:0.0:1789607483.882094:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:0.0:1789607483.882108:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:11192:x1876539130019072:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607483.882136:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607483.882164:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbd8fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688b5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882247:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882265:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882278:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882295:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882303:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882309:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882590:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd913 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882600:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd913 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882607:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd913 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607483.882642:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607483.882646:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607483.882671:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd913 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882698:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882705:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882712:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882719:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607483.882723:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882731:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882745:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:0.0:1789607483.882754:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607483.882761:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882768:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbd905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882783:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882789:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882796:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882801:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607483.882804:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882810:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882817:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d78c73e1100) 00010000:00010000:0.0:1789607483.882819:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607483.882822:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882828:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbd90c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882927:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbd8fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688b5 expref: 8 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882954:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd913 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688b5 expref: 7 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607483.882962:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78c73e1000) 00010000:00010000:0.0:1789607483.882973:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607483.882976:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8000, rc 0) 00000100:00100000:0.0:1789607483.883078:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11192:x1876539130019072:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 973us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607483.883086:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1789607483.888084:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607483.888308:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019200 00000100:00100000:1.0:1789607483.888321:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019200 00000100:00100000:1.0:1789607483.888395:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607483.888418:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11192:x1876539130019200:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789607483.888540:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11192:x1876539130019200:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 Request processed in 134us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607483.888549:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607483.892935:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607483.893102:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019456 00000100:00100000:2.0:1789607483.893115:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019456 00000100:00100000:2.0:1789607483.893188:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:2.0:1789607483.893201:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11192:x1876539130019456:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607483.893361:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607483.893389:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd91a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688bc expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.893490:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.893521:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.893535:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.893576:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.893584:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.893591:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.894786:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580c00/0xa26202d240fbd92f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.894806:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580c00/0xa26202d240fbd92f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.894903:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580c00/0xa26202d240fbd92f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607483.894918:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789607483.895198:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895206:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895214:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895219:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607483.895224:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895244:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895258:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78c73e1000) 00010000:00010000:2.0:1789607483.895261:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607483.895267:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895272:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd921 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895286:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895291:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895297:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895301:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607483.895304:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895309:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895314:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607483.895316:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607483.895318:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.895330:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd928 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.904352:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbd91a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688bc expref: 10 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.904386:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580c00/0xa26202d240fbd92f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688bc expref: 9 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607483.904397:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:2.0:1789607483.904401:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607483.904405:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580c00, rc 0) 00000100:00100000:2.0:1789607483.904581:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:11192:x1876539130019456:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 11381us (11671us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789607483.904593:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1789607483.923094:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607483.924177:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019584 00000100:00100000:0.0:1789607483.924197:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019584 00000100:00100000:0.0:1789607483.924293:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1789607483.924306:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:11192:x1876539130019584:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789607483.924464:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:11192:x1876539130019584:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 160us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607483.924471:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:3.0:1789607483.926745:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607483.926903:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019712 00000100:00100000:0.0:1789607483.927078:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019712 00000100:00100000:1.0:1789607483.927277:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1789607483.927292:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:11192:x1876539130019712:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789607483.927840:0:6469:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 504us 00000100:00080000:3.0:1789607483.928047:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1789607483.939633:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607483.956199:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:11192:x1876539130019712:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 28899us (29453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607483.956214:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000040:00080000:1.0:1789607484.070841:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789607484.643545:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789607484.740728:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000100:00100000:1.0:1789607484.936209:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607484.936252:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607484.936394:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607484.936412:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607484.936429:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607484.936458:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019840 00000100:00100000:1.0:1789607484.936466:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019840 00000100:00100000:1.0:1789607484.936506:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 377 00000100:00100000:1.0:1789607484.936515:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130019840:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607484.936578:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130019840:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 64us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607484.936585:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 377 00000100:00100000:2.0:1789607484.938153:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130019968 00000100:00100000:2.0:1789607484.938165:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130019968 00000100:00100000:2.0:1789607484.938210:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020096 00000100:00100000:2.0:1789607484.938213:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020096 00000100:00100000:2.0:1789607484.938226:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020224 00000100:00100000:2.0:1789607484.938229:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020224 00000100:00100000:2.0:1789607484.938251:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020352 00000100:00100000:2.0:1789607484.938254:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020352 00000100:00100000:2.0:1789607484.938275:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 286 00000100:00100000:2.0:1789607484.938284:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130019968:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607484.938354:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130019968:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 71us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607484.938362:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 286 00000100:00100000:2.0:1789607484.938380:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 287 00000100:00100000:2.0:1789607484.938386:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130020096:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607484.938412:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130020096:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607484.938417:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 287 00000100:00100000:2.0:1789607484.938442:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 288 00000100:00100000:2.0:1789607484.938448:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130020224:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607484.938470:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130020224:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607484.938475:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 288 00000100:00100000:2.0:1789607484.938487:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 289 00000100:00100000:2.0:1789607484.938493:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130020352:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607484.938512:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130020352:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 20us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607484.938518:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 289 00000100:00080000:2.0:1789607484.942622:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607484.942630:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607485.154761:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607485.154827:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607485.154903:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607485.154910:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150041728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607485.154933:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607485.154975:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041856 00000100:00100000:0.0:1789607485.154983:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041856 00000100:00100000:0.0:1789607485.155039:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041728 00000100:00100000:0.0:1789607485.155043:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041728 00000100:00100000:0.0:1789607485.155060:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789607485.155069:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150041856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607485.155099:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607485.155143:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150041856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.155150:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789607485.155167:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789607485.155173:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150041728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607485.155182:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607485.155206:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150041728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.155211:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789607485.155249:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150041728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607485.155261:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150041856:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789607485.155366:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607485.156823:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150042112:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.156891:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607485.156922:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607485.156928:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150041984:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.156964:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607485.156985:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607485.156992:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150042496:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.157014:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607485.157025:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150042240:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.157042:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150042624:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.157061:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607485.157075:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150043136:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.157094:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607485.157110:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607485.157114:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150043008:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.157137:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607485.157162:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150041984 00000100:00100000:3.0:1789607485.157169:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150041984 00000100:00100000:1.0:1789607485.157170:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607485.157192:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150042752:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.157204:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789607485.157211:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150041984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607485.157211:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607485.157225:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150043264:0@lo:400:kworker.0 00000100:00100000:1.0:1789607485.157241:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607485.157251:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150041984:12345-0@lo:400:kworker.0 Request processed in 41us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607485.157254:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607485.157257:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789607485.157258:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150042368:0@lo:400:kworker.0 00000100:00100000:1.0:1789607485.157276:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607485.157287:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150042880:0@lo:400:kworker.0 00000100:00100000:1.0:1789607485.157303:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607485.157328:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042496 00000100:00100000:1.0:1789607485.157332:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042496 00000100:00100000:1.0:1789607485.157354:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042240 00000100:00100000:1.0:1789607485.157357:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042240 00000100:00100000:3.0:1789607485.157363:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150041984:0@lo:400:kworker.0 00000100:00100000:1.0:1789607485.157379:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789607485.157385:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150042496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607485.157431:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150042496:12345-0@lo:400:kworker.0 Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607485.157437:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789607485.157444:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042112 00000100:00100000:0.0:1789607485.157448:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042112 00000100:00100000:1.0:1789607485.157449:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789607485.157455:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150042240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157467:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042624 00000100:00100000:0.0:1789607485.157469:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042624 00000100:00100000:1.0:1789607485.157486:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150042240:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157486:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150043136 00000100:00100000:0.0:1789607485.157488:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150043136 00000100:00100000:1.0:1789607485.157491:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789607485.157499:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042752 00000100:00100000:0.0:1789607485.157502:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042752 00000100:00100000:0.0:1789607485.157513:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150043264 00000100:00100000:0.0:1789607485.157514:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150043264 00000100:00100000:1.0:1789607485.157517:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150042240:0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157524:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042368 00000100:00100000:0.0:1789607485.157526:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042368 00000100:00100000:0.0:1789607485.157548:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789607485.157553:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150042112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157584:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150042112:12345-0@lo:400:kworker.0 Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157590:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789607485.157602:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789607485.157606:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150042624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157629:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150042624:12345-0@lo:400:kworker.0 Request processed in 22us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157634:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789607485.157643:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789607485.157648:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150043136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157672:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150043136:12345-0@lo:400:kworker.0 Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157677:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789607485.157688:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789607485.157694:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150042752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157725:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150042752:12345-0@lo:400:kworker.0 Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157730:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789607485.157739:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789607485.157745:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150043264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157767:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150043264:12345-0@lo:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157772:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789607485.157792:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789607485.157797:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150042368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157826:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150042368:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157831:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789607485.157847:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150043008 00000100:00100000:0.0:1789607485.157850:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150043008 00000100:00100000:0.0:1789607485.157896:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150042880 00000100:00100000:0.0:1789607485.157899:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150042880 00000100:00100000:0.0:1789607485.157918:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789607485.157924:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150043008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.157953:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150043008:12345-0@lo:400:kworker.0 Request processed in 30us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.157971:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789607485.157984:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789607485.157989:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150042880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607485.158014:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150042880:12345-0@lo:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.158019:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789607485.158058:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150042368:0@lo:400:kworker.0 00010000:00080000:0.0:1789607485.158070:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f77c8e00 x1876539150042880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607485.158080:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150042880:0@lo:400:kworker.0 00010000:00080000:0.0:1789607485.158089:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f77cb100 x1876539150042752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607485.158108:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150042752:0@lo:400:kworker.0 00010000:00080000:0.0:1789607485.158120:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f77c8700 x1876539150043264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607485.158128:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150043264:0@lo:400:kworker.0 00010000:00080000:3.0:1789607485.158288:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f77c9880 x1876539150043008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607485.158309:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150043008:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.158319:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150042624:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.158328:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150043136:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.158336:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150042496:0@lo:400:kworker.0 00000100:00100000:3.0:1789607485.158345:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150042112:0@lo:400:kworker.0 00000100:00080000:2.0:1789607485.169351:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607485.169361:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607485.169365:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789607485.666088:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607485.788737:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607485.788822:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020480 00000100:00100000:3.0:1789607485.788845:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020480 00000100:00100000:3.0:1789607485.788963:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1789607485.788974:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:11234:x1876539130020480:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607485.788991:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607485.789013:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd93d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688c3 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789104:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789117:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789129:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789142:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789149:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789155:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789393:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789406:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789417:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789434:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607485.789441:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789453:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789471:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:3.0:1789607485.789475:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607485.789482:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789493:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbd944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789508:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789513:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789518:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789523:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607485.789526:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789532:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789550:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d78d9b83900) 00010000:00010000:3.0:1789607485.789552:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607485.789555:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789567:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd94b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789614:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd93d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688c3 expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789631:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:3.0:1789607485.789633:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607485.789639:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd93d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688c3 expref: 9 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.789725:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571fc00, rc 0) 00000100:00100000:3.0:1789607485.789799:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:11234:x1876539130020480:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 827us (1077us total) trans 0 rc 301/301 00000100:00100000:3.0:1789607485.789807:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00080000:2.0:1789607485.790513:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607485.795562:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607485.797807:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020736 00000100:00100000:3.0:1789607485.797822:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020736 00000100:00100000:3.0:1789607485.797892:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1789607485.797903:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:11234:x1876539130020736:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:3.0:1789607485.797974:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607485.797998:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbd8f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ae expref: 8 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.798028:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4500) 00010000:00010000:3.0:1789607485.798038:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607485.798235:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.798248:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.798257:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.798269:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.798275:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.798281:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799216:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799228:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799237:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607485.799251:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043644b9c reply state 00000000d418ed35 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799274:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799281:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607485.799284:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607485.799287:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789607485.799292:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789607485.799301:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799308:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799314:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799319:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607485.799323:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799330:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799340:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83200) 00010000:00010000:3.0:1789607485.799342:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607485.799347:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799353:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd952 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607485.799380:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043644b9c reply state 00000000d418ed35 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799389:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.799394:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607485.799397:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607485.799399:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789607485.799503:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:11234:x1876539130020736:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 1600us (3947us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789607485.799512:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1789607485.876549:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607485.878093:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020864 00000100:00100000:0.0:1789607485.878106:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020864 00000100:00100000:0.0:1789607485.878159:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1789607485.878170:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:11242:x1876539130020864:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:0.0:1789607485.878193:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607485.878215:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688ca expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.878275:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd96e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.878289:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.878312:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607485.878344:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607485.878348:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607485.878387:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.878412:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ca expref: 11 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.878436:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ca expref: 10 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.878445:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:0.0:1789607485.878448:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607485.878452:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9a00, rc 0) 00000100:00100000:0.0:1789607485.878515:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:11242:x1876539130020864:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 347us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.878522:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1789607485.932849:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607485.932982:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130020992 00000100:00100000:0.0:1789607485.932993:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130020992 00000100:00100000:0.0:1789607485.933052:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:0.0:1789607485.933061:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:11248:x1876539130020992:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607485.933080:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607485.933100:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688d1 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933159:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933173:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933184:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933193:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933210:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933217:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933314:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbd98a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933323:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbd98a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933330:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbd98a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607485.933355:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789607485.933359:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607485.933396:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbd98a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933408:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933414:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933421:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933427:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607485.933430:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933444:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933456:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:0.0:1789607485.933458:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607485.933463:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933469:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbd97c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933479:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933484:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933490:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933494:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607485.933497:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933503:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933510:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607485.933512:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607485.933515:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933532:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbd983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933557:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbd975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d1 expref: 12 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933570:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbd98a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d1 expref: 11 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.933577:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607485.933579:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789607485.933582:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8e00, rc 0) 00000100:00100000:0.0:1789607485.933641:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:11248:x1876539130020992:12345-192.168.203.25@tcp:101:bash.0 Request processed in 580us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.933649:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:0.0:1789607485.936305:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607485.936430:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130021248 00000100:00100000:3.0:1789607485.936441:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130021248 00000100:00100000:3.0:1789607485.936498:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:3.0:1789607485.936509:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:11248:x1876539130021248:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1789607485.936528:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607485.936547:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd991 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688d8 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.936662:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.936675:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.936686:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.936760:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.936769:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.936776:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607485.937503:0:12196:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789607485.937681:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937692:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937700:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937737:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937745:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937752:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937758:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607485.937762:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937781:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937793:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607485.937796:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607485.937801:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937808:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd998 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607485.937823:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051847d63 reply state 00000000af4ea385 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937833:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937839:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:3.0:1789607485.937841:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607485.937844:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789607485.937904:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd991 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 14 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.937918:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 13 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607485.938370:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:3.0:1789607485.938374:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607485.938378:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f800, rc 0) 00000100:00100000:2.0:1789607485.939524:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11248:x1876539130021248:12345-192.168.203.25@tcp:101:bash.0 Request processed in 3010us (3229us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789607485.939534:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:3.0:1789607485.942205:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607485.942275:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130021376 00000100:00100000:0.0:1789607485.942283:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130021376 00000100:00100000:0.0:1789607485.942341:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:0.0:1789607485.942350:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876539130021376:12345-192.168.203.25@tcp:8:bash.0 00010000:00080000:0.0:1789607485.942380:0:9649:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1789607485.942415:0:9649:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbd9b4 00002000:00100000:0.0:1789607485.942426:0:9649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8/ffff8d78f76ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607485.942449:0:9649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607485.942671:0:9649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607485.942715:0:9649:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd6f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607485.942796:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539130021376:12345-192.168.203.25@tcp:8:bash.0 Request processed in 446us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.942804:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:3.0:1789607485.950045:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607485.952014:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130021504 00000100:00100000:0.0:1789607485.952035:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130021504 00000100:00100000:0.0:1789607485.952122:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:0.0:1789607485.952132:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:0:x1876539130021504:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607485.952149:0:8113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607485.952170:0:8113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688df expref: -99 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607485.952207:0:8113:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607485.952235:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789607485.952239:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607485.952248:0:8113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 7 pid: 8113 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.952271:0:8113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 7 pid: 8113 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.952289:0:8113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8800, rc 0) 00000100:00100000:0.0:1789607485.952401:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:0:x1876539130021504:12345-192.168.203.25@tcp:101:bash.0 Request processed in 268us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607485.952408:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00080000:2.0:1789607485.952490:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607485.955495:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607485.955590:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130021632 00000100:00100000:0.0:1789607485.955604:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130021632 00000100:00100000:0.0:1789607485.955684:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1789607485.955696:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11248:x1876539130021632:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607485.955719:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607485.955738:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688e6 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.955774:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 8 pid: 8113 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.955787:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607485.955791:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607485.955800:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.955837:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 8 pid: 8113 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607485.955854:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 8 pid: 8113 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607485.955900:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150043392:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607485.955989:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607485.958358:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607485.958448:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130021760 00000100:00100000:1.0:1789607485.958456:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130021760 00010000:00010000:1.0:1789607485.958493:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 9 pid: 8113 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607485.958532:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607485.958542:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2395:x1876539130021760:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607485.958556:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607485.958577:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 9 pid: 8113 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607485.958589:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 9 pid: 8113 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607485.958640:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607485.958646:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607485.958660:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607485.958677:0:6456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607485.958728:0:6456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607485.958748:0:6456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150043520:192.168.203.25@tcp:105: 00000100:00100000:1.0:1789607485.958835:0:6456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c8136480 going to sleep for 11 seconds 00010000:00010000:2.0:1789607485.959005:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbd9bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688df expref: 9 pid: 8113 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607485.959022:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150043392:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607485.959045:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607485.959055:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:2.0:1789607485.959089:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:11248:x1876539130021632:12345-192.168.203.25@tcp:101:bash.0 Request processed in 3396us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607485.959098:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1789607485.961166:0:6456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150043520:192.168.203.25@tcp:105: 00010000:00010000:1.0:1789607485.961188:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607485.961246:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130021760:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 2704us (2895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607485.961256:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1789607485.962974:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607485.963083:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130022016 00000100:00100000:2.0:1789607485.963092:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130022016 00000100:00100000:2.0:1789607485.963186:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1789607485.963196:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11248:x1876539130022016:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:2.0:1789607485.963622:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11248:x1876539130022016:12345-192.168.203.25@tcp:35:bash.0 Request processed in 426us (652us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789607485.963629:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:0.0:1789607486.053675:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607486.053817:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130022272 00000100:00100000:3.0:1789607486.053827:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130022272 00000100:00100000:3.0:1789607486.053920:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:3.0:1789607486.053944:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11258:x1876539130022272:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607486.053978:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607486.053998:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd9c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688ed expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607486.054083:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789607486.054222:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd9c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ed expref: 17 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.054237:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:3.0:1789607486.054240:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607486.054245:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd9c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ed expref: 17 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.054260:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ee00, rc 0) 00000100:00100000:3.0:1789607486.054321:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:11258:x1876539130022272:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 379us (655us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789607486.054328:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:3.0:1789607486.058198:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.058276:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130022528 00000100:00100000:0.0:1789607486.058285:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130022528 00000100:00100000:0.0:1789607486.058352:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1789607486.058363:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:11258:x1876539130022528:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607486.058680:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:11258:x1876539130022528:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 318us (489us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789607486.058687:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1789607486.134481:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607486.134574:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130022656 00000100:00100000:3.0:1789607486.134583:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130022656 00000100:00100000:3.0:1789607486.134824:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1789607486.134844:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:11264:x1876539130022656:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607486.134902:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607486.134923:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd9d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688f4 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.134996:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd9de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.135009:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd9de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.135023:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd9de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607486.135058:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789607486.135062:0:6468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607486.135081:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd9de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.135117:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbd9d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688f4 expref: 19 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.135135:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd9de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688f4 expref: 18 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.135143:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607486.135145:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607486.135148:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f200, rc 0) 00000100:00100000:3.0:1789607486.135200:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:11264:x1876539130022656:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 358us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607486.135216:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:0.0:1789607486.139206:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.139302:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130022912 00000100:00100000:2.0:1789607486.139312:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130022912 00000100:00100000:2.0:1789607486.139396:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:2.0:1789607486.139406:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:11264:x1876539130022912:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607486.139426:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607486.139444:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd9e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6688fb expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.139536:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd9ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.139549:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd9ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.139561:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd9ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607486.139572:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789607486.139703:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbd9e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688fb expref: 21 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.139721:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd9ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688fb expref: 20 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.139730:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:2.0:1789607486.139733:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607486.139737:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581200, rc 0) 00000100:00100000:2.0:1789607486.139797:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11264:x1876539130022912:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 392us (599us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789607486.139817:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607486.145622:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607486.145715:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607486.145795:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130023296 00000100:00100000:3.0:1789607486.145804:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130023296 00000100:00100000:1.0:1789607486.146327:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:1.0:1789607486.146341:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:2393:x1876539130023296:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607486.146357:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607486.146395:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbd9ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688fb expref: 20 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.146413:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:1.0:1789607486.146418:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607486.146476:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:2393:x1876539130023296:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 139us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607486.146482:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607486.149692:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130023168 00000100:00100000:0.0:1789607486.149708:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130023168 00000100:00100000:0.0:1789607486.149898:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1789607486.149909:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:11264:x1876539130023168:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607486.150013:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607486.150035:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbd9fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668902 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.150134:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbda01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.150147:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbda01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.150157:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbda01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607486.150170:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789607486.151318:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbd9fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668902 expref: 22 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.151341:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbda01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668902 expref: 21 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.151368:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:0.0:1789607486.151371:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607486.151375:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8600, rc 0) 00000100:00100000:0.0:1789607486.151489:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:11264:x1876539130023168:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1580us (5876us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789607486.151497:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:1.0:1789607486.159377:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.159469:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130023424 00000100:00100000:2.0:1789607486.159479:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130023424 00000100:00100000:2.0:1789607486.159562:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1789607486.159573:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130023424:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:2.0:1789607486.159615:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.159635:0:13082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.159644:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789607486.159649:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607486.159653:0:13082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.159686:0:13082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.159700:0:13082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 7 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607486.159714:0:13082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13082:1876539150043648:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607486.159960:0:13082:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d944ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607486.162520:0:13082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13082:1876539150043648:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607486.162554:0:13082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607486.167395:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607486.168005:0:8117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130023552 00000100:00100000:3.0:1789607486.168016:0:8117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130023552 00002000:00100000:3.0:1789607486.168069:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d78f77c9180 x1876539130023552/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:42/0 lens 504/0 e 0 to 0 dl 1789607497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607486.168081:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78f77c9180 with x1876539130023552 ext(0->12) 00010000:00010000:3.0:1789607486.168090:0:8117:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 8 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.168117:0:8117:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 8 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607486.168125:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d78f77c9180 00000100:00100000:3.0:1789607486.168156:0:8117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:3.0:1789607486.168166:0:8117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130023552:12345-192.168.203.25@tcp:4:lfs.0 00000001:00100000:0.0:1789607486.213755:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000100:00100000:1.0:1789607486.216028:0:8117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130023552:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 47857us (48637us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789607486.216044:0:8117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00002000:00100000:1.0:1789607486.216056:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d78f77c9180 x1876539130023552/t4294967300(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:42/0 lens 504/448 e 0 to 0 dl 1789607497 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607486.216066:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78f77c9180 with x1876539130023552 ext(0->12) 00010000:00010000:1.0:1789607486.216076:0:8117:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.216096:0:8117:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607486.216104:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d78f77c9180 00000100:00100000:2.0:1789607486.218594:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.218809:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130023680 00000100:00100000:0.0:1789607486.218819:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130023680 00010000:00010000:0.0:1789607486.218895:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607486.219050:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1789607486.219060:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2394:x1876539130023680:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607486.219074:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789607486.219091:0:7268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789607486.219094:0:7268:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789607486 00002000:00010000:0.0:1789607486.219097:0:7268:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789607486 00002000:00010000:0.0:1789607486.219099:0:7268:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789607486 00010000:00010000:0.0:1789607486.219114:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.219133:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.219157:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5f2a98/0xa26202d240fbd9c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688e6 expref: 9 pid: 8112 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.219173:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607486.219177:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607486.219182:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.219191:0:7268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.219217:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607486.219345:0:13082:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219355:0:13082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219378:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219386:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219394:0:13082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219401:0:13082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607486.219405:0:13082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219414:0:13082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219428:0:13082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.219436:0:13082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbda0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607486.219520:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130023680:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 461us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607486.219528:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:2.0:1789607486.220406:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130023424:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 60831us (61035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607486.220415:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:3.0:1789607486.224889:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.225193:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130023936 00000100:00100000:2.0:1789607486.225202:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130023936 00000100:00100000:2.0:1789607486.225400:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1789607486.225411:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:11264:x1876539130023936:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:2.0:1789607486.225474:0:6471:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbda01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668902 expref: 21 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607486.225750:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789607486.225908:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789607486.227491:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1789607486.228413:0:6471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.228448:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 25 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.228457:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.228496:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 25 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.228513:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 25 pid: 12196 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607486.228527:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6471:1876539150043776:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607486.228672:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c9277d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607486.232629:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6471:1876539150043776:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607486.232662:0:6471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607486.234601:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607486.234789:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130024064 00000100:00100000:1.0:1789607486.234800:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130024064 00010000:00010000:1.0:1789607486.234837:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 26 pid: 12196 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607486.234906:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1789607486.234916:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:2395:x1876539130024064:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607486.234939:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607486.234965:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 26 pid: 12196 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.234976:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 26 pid: 12196 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.234999:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbd9a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d8 expref: 26 pid: 12196 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.235013:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:1.0:1789607486.235019:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.235029:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.235036:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.235071:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607486.235126:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:2395:x1876539130024064:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 211us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607486.235133:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00010000:00010000:3.0:1789607486.235421:0:6471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.235430:0:6471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607486.235545:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1789607486.235745:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789607486.236987:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150043904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607486.237051:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607486.237079:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607486.237209:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150043904 00000100:00100000:1.0:1789607486.237215:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150043904 00000100:00100000:1.0:1789607486.237257:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789607486.237265:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6471:x1876539150043904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607486.237341:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6471:x1876539150043904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607486.237365:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789607486.237435:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c416f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150043904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789607486.238060:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789607486.238141:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150044032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607486.238173:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607486.238202:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607486.238339:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150044032 00000100:00100000:3.0:1789607486.238345:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150044032 00000100:00100000:3.0:1789607486.238376:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789607486.238383:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6471:x1876539150044032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789607486.238551:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6471:x1876539150044032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 167us (376us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789607486.238559:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789607486.238694:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150044032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789607486.238741:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789607486.238779:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.238800:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.238806:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.238812:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607486.238816:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.238823:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.238839:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:2.0:1789607486.238842:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789607486.238847:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.238853:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbda16 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607486.239246:0:6471:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789607486.239437:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789607486.239449:0:6471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391196586565ns, next at 392196584546ns, rc = 0 00000001:00080000:2.0:1789607486.239456:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789607486.239491:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83900) 00010000:00010000:2.0:1789607486.239495:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789607486.239501:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbda01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668902 expref: 29 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607486.239610:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:11264:x1876539130023936:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 14200us (14729us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789607486.239619:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000020:00080000:2.0:1789607486.239623:0:6471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789607486.246120:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.246346:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130024192 00000100:00100000:2.0:1789607486.246356:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130024192 00000100:00100000:2.0:1789607486.246407:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:2.0:1789607486.246417:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:11264:x1876539130024192:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607486.246442:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607486.246463:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbda1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668909 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.246522:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbda1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668909 expref: 29 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.246537:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbda1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668909 expref: 29 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.246556:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607486.246560:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607486.246564:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581000, rc 0) 00000100:00100000:2.0:1789607486.246612:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:11264:x1876539130024192:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 197us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607486.246619:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:3.0:1789607486.249226:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.249300:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130024448 00000100:00100000:0.0:1789607486.249310:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130024448 00000100:00100000:0.0:1789607486.249367:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:0.0:1789607486.249377:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0073050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:11264:x1876539130024448:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607486.249603:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0073050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:11264:x1876539130024448:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 227us (384us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789607486.249611:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:0.0:1789607486.330116:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.330197:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130024704 00000100:00100000:2.0:1789607486.330218:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130024704 00000100:00100000:2.0:1789607486.330299:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:2.0:1789607486.330309:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:11274:x1876539130024704:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607486.330331:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607486.330353:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbda24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668910 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607486.330444:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789607486.330559:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbda24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668910 expref: 32 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.330573:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:2.0:1789607486.330576:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607486.330581:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbda24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668910 expref: 32 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.330595:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607486.330657:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11274:x1876539130024704:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 349us (559us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789607486.330665:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1789607486.338138:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.338330:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130024832 00000100:00100000:0.0:1789607486.338341:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130024832 00000100:00100000:0.0:1789607486.338401:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:0.0:1789607486.338412:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11274:x1876539130024832:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1789607486.338486:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338502:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338513:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338525:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338532:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338539:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338616:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338624:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338630:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607486.338687:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338700:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338706:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338712:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338718:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607486.338722:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338728:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338739:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607486.338742:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607486.338747:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338753:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbda32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338772:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338778:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338791:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338796:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607486.338804:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338811:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338820:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:0.0:1789607486.338822:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607486.338825:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338831:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338842:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338848:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338853:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.338858:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607486.339101:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.339120:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.339130:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607486.339132:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607486.339135:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.339141:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607486.339222:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11274:x1876539130024832:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 810us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607486.339230:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:3.0:1789607486.342621:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.342704:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130025088 00000100:00100000:0.0:1789607486.342716:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130025088 00000100:00100000:0.0:1789607486.342775:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1789607486.342786:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11274:x1876539130025088:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607486.343066:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:11274:x1876539130025088:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 281us (452us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789607486.343073:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1789607486.390403:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607486.390710:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130025344 00000100:00100000:3.0:1789607486.390719:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130025344 00000100:00100000:3.0:1789607486.391322:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607486.391335:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:11277:x1876539130025344:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607486.391364:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607486.391386:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbda47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668917 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391463:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391478:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391489:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391499:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391515:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391522:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391627:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391636:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391642:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607486.391651:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789607486.391743:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391751:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391818:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391826:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607486.391830:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391838:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391879:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607486.391883:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607486.391888:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391894:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbda4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.391908:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392390:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392397:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392401:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607486.392404:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392411:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392420:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:3.0:1789607486.392423:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607486.392426:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392431:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbda55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392489:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbda47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 35 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392501:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 34 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607486.392509:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:3.0:1789607486.392511:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607486.392514:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e600, rc 0) 00000100:00100000:3.0:1789607486.392588:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11277:x1876539130025344:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1256us (2194us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789607486.392596:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607486.395299:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.395410:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130025472 00000100:00100000:0.0:1789607486.395420:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130025472 00000100:00100000:0.0:1789607486.395472:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:0.0:1789607486.395480:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11277:x1876539130025472:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607486.395538:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395569:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395580:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395603:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395609:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395616:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395622:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607486.395626:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395633:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395643:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607486.395645:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607486.395650:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.395655:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607486.395720:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11277:x1876539130025472:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 240us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607486.395732:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:1.0:1789607486.401032:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.401274:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130025728 00000100:00100000:0.0:1789607486.401284:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130025728 00000100:00100000:0.0:1789607486.401378:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1789607486.401389:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11277:x1876539130025728:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607486.401606:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:11277:x1876539130025728:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 219us (749us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789607486.401614:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00010000:00010000:0.0:1789607486.690564:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607486.735785:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.735955:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130025984 00000100:00100000:0.0:1789607486.735964:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130025984 00000100:00100000:0.0:1789607486.736022:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:0.0:1789607486.736032:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:11308:x1876539130025984:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:0.0:1789607486.736058:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607486.736080:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66891e expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.736447:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.736464:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.736476:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607486.736487:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789607486.736623:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbda71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66891e expref: 38 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.736655:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66891e expref: 37 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.736663:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607486.736666:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607486.736669:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:0.0:1789607486.736733:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:11308:x1876539130025984:12345-192.168.203.25@tcp:101:cat.0 Request processed in 702us (957us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789607486.736741:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1789607486.748985:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607486.749033:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607486.749214:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130026368 00000100:00100000:0.0:1789607486.749224:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130026368 00000100:00100000:0.0:1789607486.749276:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607486.749285:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:2396:x1876539130026368:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607486.749309:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607486.749333:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbda78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66891e expref: 37 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607486.749351:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607486.749356:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607486.749415:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+36:2396:x1876539130026368:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 131us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607486.749423:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:2.0:1789607486.750168:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130026240 00000100:00100000:2.0:1789607486.750175:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130026240 00000100:00100000:2.0:1789607486.750224:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1789607486.750232:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+36:11308:x1876539130026240:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:2.0:1789607486.750519:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:11308:x1876539130026240:12345-192.168.203.25@tcp:35:cat.0 Request processed in 286us (1542us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789607486.750528:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1789607486.868816:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.868908:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130026624 00000100:00100000:2.0:1789607486.868923:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130026624 00000100:00100000:2.0:1789607486.868989:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:2.0:1789607486.868998:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:11314:x1876539130026624:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:2.0:1789607486.869023:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607486.869025:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789607486.869050:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbd9de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688f4 expref: 37 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.869070:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:2.0:1789607486.869074:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607486.869087:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbda86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668925 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.869168:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.869181:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 37 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.869189:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.869216:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 37 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.869228:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 37 pid: 6470 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607486.869258:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d96680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150044160:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607486.869344:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607486.873195:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d96680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150044160:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607486.873233:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607486.873661:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607486.876277:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130026752 00000100:00100000:1.0:1789607486.876301:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130026752 00010000:00010000:1.0:1789607486.876351:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 38 pid: 6470 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607486.876393:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:1.0:1789607486.876404:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:2396:x1876539130026752:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607486.876613:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607486.876622:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 38 pid: 6470 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.876636:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 38 pid: 6470 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.876658:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbda5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668917 expref: 38 pid: 6470 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.876740:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:1.0:1789607486.876747:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.876757:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.876765:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607486.876811:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607486.876898:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:2396:x1876539130026752:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 495us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607486.876907:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00010000:00010000:2.0:1789607486.877068:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.877078:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607486.877095:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789607486.877277:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbda86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 39 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.877310:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 38 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.877318:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607486.877320:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607486.877323:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581800, rc 0) 00000100:00100000:2.0:1789607486.877351:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:11314:x1876539130026624:12345-192.168.203.25@tcp:101:dd.0 Request processed in 8354us (8545us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789607486.877358:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607486.882340:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607486.882531:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130027008 00000100:00100000:2.0:1789607486.882554:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130027008 00000100:00100000:2.0:1789607486.882614:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:2.0:1789607486.882625:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:11314:x1876539130027008:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:2.0:1789607486.883198:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.883216:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.883227:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607486.883276:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1789607486.883374:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001461707f reply state 000000001231f742 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.883388:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607486.883396:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607486.883399:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607486.883403:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607486.883623:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:11314:x1876539130027008:12345-192.168.203.25@tcp:36:dd.0 Request processed in 998us (1290us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789607486.883631:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000020:00080000:2.0:1789607486.883636:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1789607487.012747:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789607487.138562:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607487.202125:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607487.202196:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607487.203170:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150044288 00000100:00100000:0.0:1789607487.203179:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150044288 00000100:00080000:2.0:1789607487.203244:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607487.203255:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607487.203266:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150044288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607487.203300:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607487.203368:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150044288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607487.203375:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789607487.203442:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607487.203454:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607487.203479:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607487.203485:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607487.203526:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150044416 00000100:00100000:2.0:1789607487.203530:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150044416 00000100:00100000:2.0:1789607487.203579:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789607487.203586:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150044416:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789607487.203710:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789607487.203746:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607487.203786:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150044416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607487.203792:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789607487.203881:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607487.286521:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.286792:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130027136 00000100:00100000:0.0:1789607487.286803:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130027136 00000100:00100000:0.0:1789607487.286949:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1789607487.286963:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:11329:x1876539130027136:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:0.0:1789607487.286987:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607487.287008:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdaa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66892c expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287071:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287086:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287098:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287107:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287113:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287119:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287210:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287221:0:7709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 41 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287229:0:7709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287263:0:7709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 41 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.287276:0:7709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 41 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.287289:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150044544:192.168.203.25@tcp:104: 00000100:00080000:1.0:1789607487.287430:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607487.287583:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607487.291446:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150044544:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607487.291478:0:7709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607487.295624:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607487.296185:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130027392 00000100:00100000:2.0:1789607487.296195:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130027392 00000100:00100000:2.0:1789607487.296255:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:2.0:1789607487.296266:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+42:6371:x1876539130027392:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789607487.296606:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:6371:x1876539130027392:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 341us (991us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789607487.296614:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1789607487.299529:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.300027:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130027520 00000100:00100000:0.0:1789607487.300037:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130027520 00010000:00010000:0.0:1789607487.300080:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 43 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.300130:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:0.0:1789607487.300153:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:2396:x1876539130027520:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607487.300168:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607487.300175:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 43 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.300188:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 43 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.300210:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbda8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668925 expref: 43 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.300226:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607487.300231:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.300241:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.300248:0:7268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.300280:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607487.300554:0:7709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300563:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607487.300620:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789607487.300625:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607487.300680:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300768:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300779:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300786:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300793:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300799:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607487.300803:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300810:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300820:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607487.300823:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607487.300827:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300833:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdaa9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300854:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300859:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.300911:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301042:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607487.301047:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301054:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301062:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:3.0:1789607487.301064:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607487.301067:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301073:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdab0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301115:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdaa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66892c expref: 43 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301129:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66892c expref: 42 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.301147:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:3.0:1789607487.301149:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607487.301152:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9600, rc 0) 00000100:00100000:3.0:1789607487.301205:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+42:11329:x1876539130027136:12345-192.168.203.25@tcp:101:stat.0 Request processed in 14246us (14694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607487.301212:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1789607487.301629:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:2396:x1876539130027520:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1475us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607487.301638:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607487.408286:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607487.408375:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130027776 00000100:00100000:2.0:1789607487.408385:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130027776 00000100:00100000:2.0:1789607487.408443:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:2.0:1789607487.408455:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:11335:x1876539130027776:12345-192.168.203.25@tcp:36:truncate.0 00010000:00010000:2.0:1789607487.408511:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607487.408537:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdab7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66892c expref: 41 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607487.408557:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607487.408563:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607487.408997:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607487.409024:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607487.409035:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607487.409085:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789607487.409114:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6ddf2af reply state 00000000df347c34 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607487.409127:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607487.409133:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607487.409136:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607487.409138:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607487.409343:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:11335:x1876539130027776:12345-192.168.203.25@tcp:36:truncate.0 Request processed in 888us (1064us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789607487.409350:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000020:00080000:2.0:1789607487.409356:0:12196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607487.576167:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607487.576255:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130027904 00000100:00100000:3.0:1789607487.576265:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130027904 00000100:00100000:3.0:1789607487.576332:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607487.576343:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:11349:x1876539130027904:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:3.0:1789607487.576366:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607487.576386:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdac5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668933 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576449:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576462:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576485:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576496:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576503:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576536:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576621:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576628:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576635:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607487.576674:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789607487.576678:0:6468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607487.576697:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576710:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576718:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576724:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576731:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576736:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607487.576740:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576756:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576769:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607487.576772:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607487.576776:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576783:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdacc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576795:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576801:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576806:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576810:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607487.576815:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576820:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576826:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:3.0:1789607487.576828:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607487.576831:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.576845:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdad3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.577191:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdac5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 45 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.577206:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 44 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.577213:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:3.0:1789607487.577215:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607487.577218:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607487.577314:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:11349:x1876539130027904:12345-192.168.203.25@tcp:101:stat.0 Request processed in 973us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607487.577328:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607487.669379:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.671125:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130028160 00000100:00100000:0.0:1789607487.671138:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130028160 00000100:00100000:0.0:1789607487.671213:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:0.0:1789607487.671224:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:11359:x1876539130028160:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607487.671258:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607487.671280:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66893a expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607487.671366:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789607487.671498:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdae1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66893a expref: 46 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.671512:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:0.0:1789607487.671515:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607487.671521:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66893a expref: 46 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.671535:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8a00, rc 0) 00000100:00100000:0.0:1789607487.671601:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+45:11359:x1876539130028160:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 379us (2233us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1789607487.671608:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:2.0:1789607487.677401:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607487.677553:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130028416 00000100:00100000:1.0:1789607487.677562:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130028416 00000100:00100000:1.0:1789607487.677622:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:1.0:1789607487.677633:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+45:11359:x1876539130028416:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607487.678154:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:11359:x1876539130028416:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 521us (761us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789607487.678163:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:1.0:1789607487.714445:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150044672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607487.714522:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607487.714992:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150044672 00000100:00100000:0.0:1789607487.715000:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150044672 00000100:00100000:0.0:1789607487.715054:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789607487.715063:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150044672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607487.715109:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607487.715165:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150044672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607487.715172:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789607487.715396:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150044672:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789607487.715565:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607487.755567:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.755644:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130028672 00000100:00100000:0.0:1789607487.755655:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130028672 00000100:00100000:0.0:1789607487.755772:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:0.0:1789607487.755784:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:11365:x1876539130028672:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607487.755810:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607487.755830:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdaef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668941 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.756001:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.756028:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 47 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.756039:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.756075:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 47 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.756088:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 47 pid: 6468 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.756117:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150044800:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607487.756209:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607487.762642:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150044800:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607487.762672:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607487.763538:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607487.763627:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130028800 00000100:00100000:3.0:1789607487.763636:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130028800 00010000:00010000:3.0:1789607487.763676:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 48 pid: 6468 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607487.763715:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607487.763725:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+48:2396:x1876539130028800:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607487.763740:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607487.763748:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 48 pid: 6468 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.763769:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 48 pid: 6468 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.763790:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdada lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668933 expref: 48 pid: 6468 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.763807:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:3.0:1789607487.763812:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.763823:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.763832:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.763904:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607487.763978:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:2396:x1876539130028800:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 254us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607487.763987:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00010000:00010000:0.0:1789607487.764412:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.764429:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607487.764447:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789607487.764591:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdaef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 48 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.764607:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 47 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.764614:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607487.764617:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789607487.764620:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9600, rc 0) 00000100:00100000:0.0:1789607487.764664:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:11365:x1876539130028672:12345-192.168.203.25@tcp:101:bash.0 Request processed in 8883us (9106us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789607487.764672:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:2.0:1789607487.768445:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607487.768524:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130029056 00000100:00100000:3.0:1789607487.768535:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130029056 00000100:00100000:3.0:1789607487.768583:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:3.0:1789607487.768594:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:11365:x1876539130029056:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:3.0:1789607487.768885:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.768903:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.768944:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607487.769000:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789607487.769028:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5822a41 reply state 00000000012586f5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.769041:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607487.769050:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:3.0:1789607487.769053:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607487.769057:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607487.769284:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:11365:x1876539130029056:12345-192.168.203.25@tcp:36:bash.0 Request processed in 691us (847us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789607487.769292:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000020:00080000:3.0:1789607487.769298:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607487.775309:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.775387:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130029184 00000100:00100000:0.0:1789607487.775399:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130029184 00000100:00100000:0.0:1789607487.775465:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:0.0:1789607487.775476:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:11365:x1876539130029184:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607487.775503:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607487.775527:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668948 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.775639:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.775666:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 51 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.775675:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.775708:0:6470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 51 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.775721:0:6470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 51 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.775735:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150044928:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607487.775822:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607487.779100:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607487.779180:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130029312 00000100:00100000:1.0:1789607487.779190:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130029312 00010000:00010000:1.0:1789607487.779230:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 52 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607487.779294:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:1.0:1789607487.779304:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:2395:x1876539130029312:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607487.779320:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607487.779328:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 52 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.779342:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 52 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.779363:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:1.0:1789607487.779368:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.779378:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.779385:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.779404:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607487.779460:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:2395:x1876539130029312:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 158us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607487.779467:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00010000:00010000:0.0:1789607487.780310:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdaf6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668941 expref: 51 pid: 12196 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.780330:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150044928:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607487.780352:0:6470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.780360:0:6470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.780366:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607487.780411:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789607487.780427:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607487.780451:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.780483:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668948 expref: 51 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.780497:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668948 expref: 50 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.780505:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607487.780508:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607487.780511:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8400, rc 0) 00000100:00100000:0.0:1789607487.780555:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:11365:x1876539130029184:12345-192.168.203.25@tcp:101:bash.0 Request processed in 5080us (5255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607487.780564:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:3.0:1789607487.784307:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.784363:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130029568 00000100:00100000:0.0:1789607487.784373:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130029568 00000100:00100000:0.0:1789607487.784433:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1789607487.784444:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0071850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:11365:x1876539130029568:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:0.0:1789607487.784775:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0071850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:11365:x1876539130029568:12345-192.168.203.25@tcp:35:bash.0 Request processed in 332us (477us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789607487.784782:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607487.859562:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.859710:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130029824 00000100:00100000:0.0:1789607487.859721:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130029824 00000100:00100000:0.0:1789607487.859782:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:0.0:1789607487.859792:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:11375:x1876539130029824:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607487.859815:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607487.859850:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66894f expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607487.860133:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789607487.860250:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66894f expref: 53 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.860263:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:0.0:1789607487.860266:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607487.860270:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66894f expref: 53 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.860283:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:0.0:1789607487.860333:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:11375:x1876539130029824:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 543us (780us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1789607487.860340:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:2.0:1789607487.863644:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.863733:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130029952 00000100:00100000:0.0:1789607487.863744:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130029952 00000100:00100000:0.0:1789607487.863804:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:0.0:1789607487.863814:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:11375:x1876539130029952:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1789607487.863934:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.863962:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.863973:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864004:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864012:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864019:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864117:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864128:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864135:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607487.864178:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864193:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864200:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864208:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864215:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607487.864220:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864234:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864247:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607487.864250:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607487.864255:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864262:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864276:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864282:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864288:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864292:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607487.864295:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864301:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864308:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:0.0:1789607487.864310:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607487.864313:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864328:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864338:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864344:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864350:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864355:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607487.864358:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864364:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864373:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607487.864375:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607487.864378:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.864384:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.864591:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:11375:x1876539130029952:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 776us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607487.864600:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:1.0:1789607487.867678:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607487.867759:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130030208 00000100:00100000:2.0:1789607487.867768:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130030208 00000100:00100000:2.0:1789607487.867830:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:2.0:1789607487.867839:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:11375:x1876539130030208:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1789607487.868186:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:11375:x1876539130030208:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 346us (514us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789607487.868193:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607487.931529:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.931671:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130030464 00000100:00100000:0.0:1789607487.931681:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130030464 00000100:00100000:0.0:1789607487.931739:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1789607487.931749:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:11378:x1876539130030464:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607487.931772:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607487.931792:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668956 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.931900:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.931924:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.931945:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.931956:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.931963:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.931970:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.932079:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.932366:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.932392:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607487.932403:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789607487.932698:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932715:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932722:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932729:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607487.932734:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932741:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932754:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607487.932757:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607487.932761:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932767:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdb43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932780:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932787:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932793:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932798:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607487.932807:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932814:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932822:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:1.0:1789607487.932825:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607487.932828:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932834:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdb4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932927:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdb3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668956 expref: 56 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932951:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668956 expref: 55 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607487.932958:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:1.0:1789607487.932960:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607487.932963:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:1.0:1789607487.933032:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:11378:x1876539130030464:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1284us (1511us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789607487.933040:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:3.0:1789607487.947651:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607487.947922:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130030592 00000100:00100000:0.0:1789607487.947932:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130030592 00000100:00100000:0.0:1789607487.948008:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:0.0:1789607487.948019:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:11378:x1876539130030592:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607487.948083:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948099:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948110:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948135:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948142:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948149:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948155:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607487.948159:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948184:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948197:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607487.948200:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607487.948205:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607487.948211:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607487.948277:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:11378:x1876539130030592:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 259us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607487.948284:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:3.0:1789607487.949330:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607487.949412:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130030720 00000100:00100000:2.0:1789607487.949420:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130030720 00000100:00100000:2.0:1789607487.949477:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1789607487.949486:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:2396:x1876539130030720:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607487.949500:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607487.949519:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdb51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668956 expref: 55 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607487.949533:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607487.949537:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607487.949580:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:2396:x1876539130030720:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607487.949586:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1789607487.955777:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607487.955898:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130030976 00000100:00100000:1.0:1789607487.955908:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130030976 00000100:00100000:1.0:1789607487.955977:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1789607487.955988:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:11378:x1876539130030976:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607487.956227:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:11378:x1876539130030976:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 240us (458us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789607487.956235:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1789607488.112783:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607488.112888:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130031232 00000100:00100000:0.0:1789607488.112899:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130031232 00000100:00100000:0.0:1789607488.112964:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:0.0:1789607488.112974:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:11396:x1876539130031232:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:0.0:1789607488.112999:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607488.113019:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66895d expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.113116:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbdb6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.113130:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbdb6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.113143:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbdb6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607488.113168:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789607488.113304:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66895d expref: 58 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.113323:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbdb6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66895d expref: 57 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.113331:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607488.113334:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789607488.113337:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8200, rc 0) 00000100:00100000:0.0:1789607488.113395:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11396:x1876539130031232:12345-192.168.203.25@tcp:101:cat.0 Request processed in 421us (620us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789607488.113402:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:3.0:1789607488.143948:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607488.144008:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130031360 00000100:00100000:1.0:1789607488.144017:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130031360 00000100:00100000:1.0:1789607488.144069:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:1.0:1789607488.144078:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11397:x1876539130031360:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607488.144101:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607488.144120:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdb7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668964 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.144178:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbdb82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.144192:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbdb82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.144203:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbdb82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607488.144233:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789607488.144236:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607488.144252:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbdb82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.144285:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdb7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668964 expref: 59 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.144303:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbdb82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668964 expref: 58 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.144324:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607488.144327:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607488.144331:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031200, rc 0) 00000100:00100000:1.0:1789607488.144384:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11397:x1876539130031360:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 307us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607488.144391:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:2.0:1789607488.149628:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607488.149819:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130031744 00000100:00100000:3.0:1789607488.149830:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130031744 00000100:00100000:3.0:1789607488.149976:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1789607488.149987:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11397:x1876539130031744:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607488.150343:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11397:x1876539130031744:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 356us (722us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789607488.150351:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:2.0:1789607488.156950:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607488.157120:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130031872 00000100:00100000:1.0:1789607488.157131:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130031872 00000100:00100000:1.0:1789607488.157199:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:1.0:1789607488.157209:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11397:x1876539130031872:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:1.0:1789607488.157226:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789607488.157252:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbdb12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668948 expref: 59 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.157274:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbdb6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66895d expref: 58 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.157287:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbda1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668909 expref: 57 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607488.157297:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:1.0:1789607488.157302:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607488.157358:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:11397:x1876539130031872:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 150us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607488.157366:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:1.0:1789607488.172152:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607488.177008:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130032000 00000100:00100000:3.0:1789607488.177024:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130032000 00000100:00100000:2.0:1789607488.180623:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:2.0:1789607488.180636:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:11397:x1876539130032000:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1789607488.180984:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607488.181018:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607488.181031:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607488.182536:0:7709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607488.185231:0:7709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789607488.185337:0:7709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789607488.185486:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:11397:x1876539130032000:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 4846us (13338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607488.185498:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:3.0:1789607488.208373:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607488.209907:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130032128 00000100:00100000:0.0:1789607488.209928:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130032128 00000100:00100000:0.0:1789607488.210004:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:0.0:1789607488.210014:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:11399:x1876539130032128:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607488.210033:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607488.210066:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66896b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210128:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210142:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210168:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210179:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210185:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210191:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210272:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210281:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210287:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607488.210329:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789607488.210333:0:6468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607488.210350:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210361:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210368:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210383:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210389:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210395:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607488.210399:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210406:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210417:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607488.210420:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607488.210424:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210429:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbdb97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210441:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210446:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210451:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210456:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607488.210464:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210471:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210479:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:0.0:1789607488.210481:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607488.210486:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210493:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdb9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210520:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbdb90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 58 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210533:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 57 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607488.210540:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607488.210542:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607488.210545:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9200, rc 0) 00000100:00100000:0.0:1789607488.210610:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11399:x1876539130032128:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 598us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607488.210618:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:1.0:1789607488.226208:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f62fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150045056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607488.226303:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607488.226438:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150045056 00000100:00100000:2.0:1789607488.226447:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150045056 00000100:00100000:2.0:1789607488.226512:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789607488.226522:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150045056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607488.226565:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607488.234714:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150045056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8185us (8402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607488.234729:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789607488.238246:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f62fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150045056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789607488.739757:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607489.059471:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607489.059480:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607489.059541:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789607489.059549:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607489.059679:0:13335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f62f8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150045184:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607489.059762:0:13335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607489.072793:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607489.072821:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130032256 00000100:00100000:0.0:1789607489.072829:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130032256 00000100:00100000:0.0:1789607489.072900:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:0.0:1789607489.072917:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130032256:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607489.072955:0:12196:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607489.073056:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130032256:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 140us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607489.073063:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00080000:0.0:1789607489.073083:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607489.073392:0:13335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f62f8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150045184:192.168.203.25@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1789607489.078498:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607489.078508:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607489.078545:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789607489.078550:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607489.078997:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.079073:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130032384 00000100:00100000:1.0:1789607489.079082:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130032384 00000100:00100000:1.0:1789607489.079131:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:1.0:1789607489.079141:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11410:x1876539130032384:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.079209:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079227:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079240:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079255:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079261:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079268:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079302:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079323:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079330:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607489.079370:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789607489.079374:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607489.079385:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079396:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079402:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079409:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079415:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607489.079420:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079427:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079438:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:1.0:1789607489.079441:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607489.079446:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079463:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031c00/0xa26202d240fbdbac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079476:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079482:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079488:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079493:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607489.079495:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079501:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079509:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607489.079512:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607489.079514:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079521:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031800/0xa26202d240fbdbb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079534:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079540:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079550:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079555:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607489.079558:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079563:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079570:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:1.0:1789607489.079572:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607489.079575:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.079580:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.079640:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11410:x1876539130032384:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 500us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.079648:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:0.0:1789607489.092263:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.093123:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130032640 00000100:00100000:2.0:1789607489.093133:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130032640 00000100:00100000:2.0:1789607489.093200:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:2.0:1789607489.093219:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11410:x1876539130032640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607489.093244:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607489.093265:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdbc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668972 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094104:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094123:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094135:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607489.094146:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789607489.094239:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094246:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094253:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094259:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607489.094263:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094271:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094283:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607489.094430:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607489.094437:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094445:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdbc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094495:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdbc1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668972 expref: 59 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094506:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:2.0:1789607489.094509:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607489.094513:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdbc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668972 expref: 59 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.094523:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580000, rc 0) 00000100:00100000:2.0:1789607489.094602:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130032640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1384us (2346us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789607489.094611:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:2.0:1789607489.099590:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607489.099652:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130032768 00000100:00100000:0.0:1789607489.099662:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130032768 00000100:00100000:0.0:1789607489.099718:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:0.0:1789607489.099729:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130032768:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607489.099766:0:6469:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607489.099858:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130032768:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607489.099882:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:0.0:1789607489.108000:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.109437:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130033024 00000100:00100000:1.0:1789607489.109452:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130033024 00000100:00100000:1.0:1789607489.109508:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:1.0:1789607489.109518:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130033024:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.109537:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607489.109540:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789607489.109564:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c0031200/0xa26202d240fbdb82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668964 expref: 58 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.109592:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607489.109602:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607489.109616:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbd6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668979 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607489.110046:0:6468:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789607489.110244:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdbdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.110258:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdbdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.110267:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdbdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.110320:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbd6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668979 expref: 60 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.110335:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdbdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668979 expref: 59 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.110343:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607489.110346:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607489.110348:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607489.110405:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11410:x1876539130033024:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 888us (2427us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789607489.110413:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:0.0:1789607489.124386:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.124980:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130033280 00000100:00100000:1.0:1789607489.124991:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130033280 00000100:00100000:1.0:1789607489.125045:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:1.0:1789607489.125063:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11410:x1876539130033280:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.125118:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607489.125143:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdbdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668979 expref: 59 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131463:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607489.131486:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607489.131520:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131537:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131549:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131565:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131572:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131579:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131647:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131671:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131678:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131684:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607489.131688:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131696:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131706:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607489.131709:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607489.131712:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131718:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdbeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131730:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131736:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131740:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131745:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607489.131753:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131759:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131766:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb4d57c04 (ffff8d78e28a4900) 00010000:00010000:1.0:1789607489.131769:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607489.131771:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.131776:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdbf2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb4d57c04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.131884:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130033280:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 6827us (7504us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607489.131893:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:0.0:1789607489.146760:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.146821:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130033408 00000100:00100000:2.0:1789607489.146831:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130033408 00000100:00100000:2.0:1789607489.146899:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:2.0:1789607489.146920:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11410:x1876539130033408:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607489.146948:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607489.146972:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdbf9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668980 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.147020:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.147043:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.147055:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.147145:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdbf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 60 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.147160:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 59 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.147169:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607489.147172:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607489.147175:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607489.147226:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11410:x1876539130033408:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 309us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607489.147233:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:0.0:1789607489.150016:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.150238:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130033664 00000100:00100000:2.0:1789607489.150248:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130033664 00000100:00100000:2.0:1789607489.150303:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:2.0:1789607489.150313:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11410:x1876539130033664:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789607489.150388:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.150406:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.150431:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607489.150767:0:12196:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789607489.150777:0:12196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394107914780ns, next at 395107912357ns, rc = 0 00000004:00010000:2.0:1789607489.150889:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007482e9a5 reply state 000000000a6fb8de transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.150903:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.150911:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607489.150914:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789607489.150918:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607489.155338:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11410:x1876539130033664:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 5015us (5320us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789607489.155350:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:0.0:1789607489.163398:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.166253:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130033792 00000100:00100000:1.0:1789607489.166266:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130033792 00000100:00100000:1.0:1789607489.166335:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 85 00000100:00100000:1.0:1789607489.166344:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11410:x1876539130033792:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.166368:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607489.166390:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668987 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.166446:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 62 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.166460:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 62 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.166495:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607489.166498:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607489.166501:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185e00, rc 0) 00000100:00100000:1.0:1789607489.166565:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:11410:x1876539130033792:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 221us (3177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.166572:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 85 00000100:00100000:2.0:1789607489.171022:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.171072:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130033920 00000100:00100000:1.0:1789607489.171082:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130033920 00000100:00100000:1.0:1789607489.171136:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:1.0:1789607489.171145:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876539130033920:12345-192.168.203.25@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789607489.171180:0:8114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:1.0:1789607489.171209:0:8114:0:(genops.c:1384:class_connect()) connect: client 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8, cookie 0xa26202d240fbdc15 00002000:00100000:1.0:1789607489.171225:0:8114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8/ffff8d78e9c8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789607489.171249:0:8114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789607489.171480:0:8114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789607489.171508:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d78e9c89800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607489.171581:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2392:x1876539130033920:12345-192.168.203.25@tcp:8:lhsmtool_posix.0 Request processed in 436us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.171588:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:2.0:1789607489.181721:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607489.182005:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130034048 00000100:00100000:3.0:1789607489.182015:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130034048 00000100:00080000:2.0:1789607489.182170:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607489.182687:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1789607489.182700:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:0:x1876539130034048:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000001:00100000:2.0:1789607489.286160:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000001:00080000:2.0:1789607489.286178:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789607489.286656:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:0:x1876539130034048:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 103954us (104950us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789607489.286667:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1789607489.295405:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607489.297060:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130034304 00000100:00100000:0.0:1789607489.297074:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130034304 00000100:00100000:0.0:1789607489.297143:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607489.297155:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:11410:x1876539130034304:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789607489.297385:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:11410:x1876539130034304:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 231us (1987us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789607489.297407:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1789607489.304124:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607489.307549:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130034560 00000100:00100000:0.0:1789607489.307566:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130034560 00000100:00100000:1.0:1789607489.307725:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:1.0:1789607489.307737:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:11410:x1876539130034560:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789607489.307846:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:11410:x1876539130034560:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 111us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.307897:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:2.0:1789607489.313435:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.313642:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130034688 00000100:00100000:1.0:1789607489.313653:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130034688 00000100:00100000:1.0:1789607489.313715:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:1.0:1789607489.313726:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:11410:x1876539130034688:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.313746:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607489.313767:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66898e expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.313836:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.313851:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.313894:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607489.313943:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607489.313962:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.313998:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66898e expref: 65 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.314014:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66898e expref: 64 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.314022:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607489.314040:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789607489.314043:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607489.314103:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:11410:x1876539130034688:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 379us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.314114:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:3.0:1789607489.316568:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.318839:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130034816 00000100:00100000:2.0:1789607489.318854:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130034816 00000100:00100000:2.0:1789607489.318954:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:2.0:1789607489.318964:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130034816:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607489.319470:0:13082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607489.319494:0:13082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668995 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607489.319520:0:13082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3e41, blocks: 0x1 00010000:00010000:2.0:1789607489.319540:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1789607489.319544:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607489.319553:0:13082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 6 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.319571:0:13082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 6 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.319584:0:13082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581000, rc 0) 00000100:00100000:2.0:1789607489.319650:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130034816:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 687us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607489.319657:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:0.0:1789607489.327950:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.328431:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035072 00000100:00100000:2.0:1789607489.328442:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035072 00000100:00100000:2.0:1789607489.328492:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:2.0:1789607489.328503:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:11410:x1876539130035072:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789607489.328605:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:11410:x1876539130035072:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 103us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607489.328612:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:0.0:1789607489.332919:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.333335:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035200 00000100:00100000:1.0:1789607489.333345:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035200 00000100:00100000:1.0:1789607489.333450:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1789607489.333462:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:11410:x1876539130035200:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.333489:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607489.333510:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e66899c expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.333539:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.333546:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607489.333550:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607489.333555:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.333586:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.333599:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.333632:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150045312:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607489.333719:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607489.346401:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.346503:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150045312:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607489.346542:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.346563:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185600, rc 0) 00000100:00100000:1.0:1789607489.346620:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11410:x1876539130035200:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 13161us (13710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.346629:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:2.0:1789607489.346899:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035328 00000100:00100000:2.0:1789607489.346931:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035328 00010000:00010000:2.0:1789607489.346961:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.347187:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:2.0:1789607489.347197:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130035328:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607489.347211:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607489.347233:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.347246:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.347267:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668995 expref: 7 pid: 13082 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.347280:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607489.347284:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607489.347292:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 6 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.347301:0:6454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 6 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.347329:0:6454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 6 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.347361:0:6454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6454:1876539150045440:192.168.203.25@tcp:105: 00000100:00100000:2.0:1789607489.347416:0:6454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c39570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607489.353518:0:6454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6454:1876539150045440:192.168.203.25@tcp:105: 00010000:00010000:2.0:1789607489.353546:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607489.353603:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130035328:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 6406us (7209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607489.353613:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:0.0:1789607489.357719:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.357816:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035456 00000100:00100000:1.0:1789607489.357826:0:8119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035456 00002000:00100000:1.0:1789607489.357921:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d78fa8f3480 x1876539130035456/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:45/0 lens 504/0 e 0 to 0 dl 1789607500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607489.357940:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fa8f3480 with x1876539130035456 ext(0->8) 00002000:00010000:1.0:1789607489.357945:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fa8f3480 00000100:00100000:1.0:1789607489.357971:0:8119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607489.357990:0:8119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539130035456:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789607489.361692:0:8119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130035456:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 3696us (3973us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789607489.361706:0:8119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00002000:00100000:1.0:1789607489.361717:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d78fa8f3480 x1876539130035456/t4294967303(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:45/0 lens 504/448 e 0 to 0 dl 1789607500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607489.361734:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fa8f3480 with x1876539130035456 ext(0->8) 00002000:00010000:1.0:1789607489.361740:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fa8f3480 00000100:00100000:0.0:1789607489.364687:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.364783:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035584 00000100:00100000:2.0:1789607489.364792:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035584 00000100:00100000:2.0:1789607489.364936:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 89 00000100:00100000:2.0:1789607489.364947:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:11410:x1876539130035584:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789607489.427853:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789607489.427941:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1789607489.427978:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789607489.427994:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78e9f319c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789607489.427998:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78efbf4100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78e9f313c0 00000020:00080000:2.0:1789607489.428001:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78efbf4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d78dbe64000 00000020:00080000:2.0:1789607489.428158:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789607489.428270:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789607489.428279:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607489.428298:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150045568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789607489.428361:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607489.428410:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150045568 00000100:00100000:2.0:1789607489.428432:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150045568 00000100:00100000:2.0:1789607489.428500:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607489.428510:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150045568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789607489.428539:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789607489.428572:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aab3e3e, atime: 0x6aab3e3e, ctime: 0x6aab3e3e, blocks: 0x1 00010000:00010000:2.0:1789607489.428580:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.428596:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1789607489.428600:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607489.428607:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.428623:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.428633:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.428640:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.428655:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789607489.428702:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:11410:x1876539130035584:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 63753us (64019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607489.428711:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 89 00010000:00010000:0.0:1789607489.428744:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.428752:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.428759:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.428766:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.429381:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429390:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429405:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607489.429408:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607489.429412:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429428:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbd959 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429449:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429455:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429460:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429466:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ea00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.429469:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429475:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429484:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607489.429486:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607489.429489:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429495:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbd960 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429509:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429514:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429643:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429650:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.429653:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429660:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429668:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:0.0:1789607489.429670:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607489.429673:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429679:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbd99f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429696:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429702:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429708:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429713:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.429716:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429733:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429742:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607489.429744:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607489.429747:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429753:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbda9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.429764:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607489.430026:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f62f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150045696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789607489.430087:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607489.431177:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150045568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2666us (2812us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789607489.431187:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607489.431211:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150045696 00000100:00100000:2.0:1789607489.431224:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150045696 00000100:00100000:2.0:1789607489.431266:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607489.431274:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150045696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789607489.431389:0:8112:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789607489.431393:0:8112:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789607490 00002000:00010000:2.0:1789607489.431395:0:8112:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789607489.431397:0:8112:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789607489 -> 1789607490 00002000:00010000:2.0:1789607489.431400:0:8112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789607489.431434:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150045696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (1347us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789607489.431441:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789607489.431483:0:3470:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78f62f8380/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789607489.431489:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f62f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150045696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1789607489.431919:0:3468:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78e9d94380/2, rc 0, transno 4294967302 00000100:00100000:1.0:1789607489.431936:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150045568:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789607489.432160:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432168:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432175:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.432179:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432188:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432204:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607489.432208:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607489.432212:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432231:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdabe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789607489.432242:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607489.432249:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607489.432251:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432261:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432268:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432274:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.432277:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432282:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432290:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:0.0:1789607489.432292:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607489.432295:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432301:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdb04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432312:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432318:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432330:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432335:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607489.432338:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432344:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432352:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:0.0:1789607489.432354:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789607489.432357:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432363:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdc07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432390:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607489.432397:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432405:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607489.432408:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432420:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432451:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.432459:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0bcd9e/0xa26202d240fbdc38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.433266:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607489.433271:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607489.433273:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607489.436457:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.436512:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035712 00000100:00100000:1.0:1789607489.436523:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035712 00000100:00100000:1.0:1789607489.436581:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:1.0:1789607489.436592:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130035712:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789607489.521596:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130035712:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 84995us (85135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607489.521608:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000001:00080000:2.0:1789607489.521749:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789607489.521763:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1789607489.524137:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.524506:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130035968 00000100:00100000:1.0:1789607489.524515:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130035968 00000100:00100000:1.0:1789607489.524568:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:1.0:1789607489.524576:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:11410:x1876539130035968:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.524623:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607489.524647:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66898e expref: 13 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.524668:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607489.524673:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607489.524699:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.524712:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.524721:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607489.525371:0:6470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1c8d730 reply state 0000000071a840d2 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.525385:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.525392:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607489.525394:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607489.525396:0:6470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607489.525482:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11410:x1876539130035968:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 905us (1354us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789607489.525489:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:1.0:1789607489.531124:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.531275:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130036096 00000100:00100000:2.0:1789607489.531285:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130036096 00000100:00100000:2.0:1789607489.531335:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1789607489.531344:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130036096:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789607489.531584:0:8113:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789607489.531588:0:8113:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789607490 -> 1789607488 00002000:00010000:2.0:1789607489.531591:0:8113:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789607486 00002000:00010000:2.0:1789607489.531592:0:8113:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789607490 -> 1789607488 00002000:00010000:2.0:1789607489.531594:0:8113:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789607489.531656:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130036096:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 312us (542us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789607489.531677:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:3.0:1789607489.534220:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.534398:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130036352 00000100:00100000:1.0:1789607489.534408:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130036352 00000100:00100000:1.0:1789607489.534461:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1789607489.534470:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11410:x1876539130036352:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789607489.534539:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.534557:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 14 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.534566:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.534602:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 14 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.534627:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 14 pid: 7709 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.534642:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150045824:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607489.534722:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607489.540387:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150045824:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607489.540418:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607489.542380:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.542614:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130036480 00000100:00100000:1.0:1789607489.542623:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130036480 00010000:00010000:1.0:1789607489.542662:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 15 pid: 7709 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.542694:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607489.542703:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:2396:x1876539130036480:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607489.542717:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607489.542724:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 15 pid: 7709 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.542737:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 15 pid: 7709 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.542757:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668980 expref: 15 pid: 7709 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.542791:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607489.542797:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.542806:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.542815:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.542850:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607489.542961:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:2396:x1876539130036480:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 258us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.542968:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00010000:00010000:2.0:1789607489.543086:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543094:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543122:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543129:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543135:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543142:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607489.543146:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543154:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543162:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607489.543165:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789607489.543169:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.543174:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdc46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.543229:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:11410:x1876539130036352:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 8760us (9017us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789607489.543237:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:3.0:1789607489.545426:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607489.545569:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130036608 00000100:00100000:0.0:1789607489.545578:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130036608 00000100:00100000:0.0:1789607489.545625:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:0.0:1789607489.545634:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130036608:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789607489.545672:0:9649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.545690:0:9649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.545699:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607489.545704:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607489.545708:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.545740:0:9649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 7 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.545772:0:9649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 7 pid: 8114 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607489.545786:0:9649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9649:1876539150045952:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607489.545854:0:9649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607489.552568:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.552659:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130036736 00000100:00100000:1.0:1789607489.552668:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130036736 00010000:00010000:1.0:1789607489.552709:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 8 pid: 8114 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.552754:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1789607489.552765:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130036736:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607489.552780:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607489.552813:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 8 pid: 8114 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.552828:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 8 pid: 8114 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.552917:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607489.552931:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607489.552938:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.552949:0:6455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.552970:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607489.553018:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130036736:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 255us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.553026:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00010000:00010000:2.0:1789607489.553756:0:9649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdc31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66899c expref: 7 pid: 8114 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.553773:0:9649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9649:1876539150045952:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607489.553805:0:9649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553816:0:9649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553824:0:9649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553850:0:9649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553896:0:9649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553914:0:9649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553944:0:9649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607489.553949:0:9649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553958:0:9649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553972:0:9649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.553979:0:9649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4f2b01b/0xa26202d240fbdc4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.554092:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539130036608:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 8458us (8674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607489.554100:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:3.0:1789607489.557538:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607489.557605:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130036992 00000100:00100000:2.0:1789607489.557616:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130036992 00000100:00100000:2.0:1789607489.557675:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:2.0:1789607489.557684:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:11410:x1876539130036992:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789607489.557758:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.557774:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.557808:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.558111:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.558122:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 14 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.558130:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.558161:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 14 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.558175:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 14 pid: 6470 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.558188:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150046080:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607489.559368:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd5d2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607489.562109:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607489.562147:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130037120 00000100:00100000:3.0:1789607489.562155:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130037120 00010000:00010000:3.0:1789607489.562191:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 15 pid: 6470 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607489.562226:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:3.0:1789607489.562236:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:2396:x1876539130037120:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607489.562250:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607489.562257:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 15 pid: 6470 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607489.562269:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 15 pid: 6470 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607489.562291:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:3.0:1789607489.562296:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607489.562305:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607489.562327:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607489.562348:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607489.562394:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:2396:x1876539130037120:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 159us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607489.562402:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00010000:00010000:0.0:1789607489.563059:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668987 expref: 14 pid: 6470 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607489.563083:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150046080:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607489.563106:0:6469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.563115:0:6469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607489.563121:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607489.563313:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789607489.563455:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789607489.563500:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789607489.563571:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6469:1876539150046208:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789607489.563615:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607489.563650:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607489.563756:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150046208 00000100:00100000:2.0:1789607489.563763:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150046208 00000100:00100000:2.0:1789607489.563810:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789607489.563818:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6469:x1876539150046208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789607489.563945:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6469:x1876539150046208:12345-0@lo:1000:mdt00_001.0 Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607489.563952:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789607489.563989:0:6469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789607489.563994:0:6469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78f62f8380, transno 4294967304 00000100:00100000:2.0:1789607489.564008:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6469:1876539150046208:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789607489.564519:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789607489.564582:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6469:1876539150046336:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789607489.564619:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607489.564641:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0f759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607489.564659:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150046336 00000100:00100000:2.0:1789607489.564662:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150046336 00000100:00100000:2.0:1789607489.564690:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789607489.564697:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6469:x1876539150046336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789607489.564844:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6469:x1876539150046336:12345-0@lo:1000:mdt00_001.0 Request processed in 147us (224us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789607489.564852:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789607489.565095:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6469:1876539150046336:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789607489.565127:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565136:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565145:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565151:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607489.565155:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565161:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565186:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607489.565188:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607489.565193:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565200:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbdc5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565229:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565235:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565240:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565245:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607489.565248:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565254:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565261:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607489.565264:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607489.565267:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565272:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbdb89 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565304:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565318:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 17 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565327:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565350:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 17 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.565363:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 17 pid: 6468 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.565374:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150046464:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607489.565424:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607489.569508:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150046464:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607489.569544:0:6469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607489.571935:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.572441:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130037248 00000100:00100000:1.0:1789607489.572451:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130037248 00010000:00010000:1.0:1789607489.572492:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 18 pid: 6468 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607489.572529:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:1.0:1789607489.572538:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:2395:x1876539130037248:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607489.572551:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607489.572557:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 18 pid: 6468 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.572570:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 18 pid: 6468 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.572608:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdba5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66896b expref: 18 pid: 6468 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.572623:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:1.0:1789607489.572628:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.572637:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.572645:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.572674:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607489.572727:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:2395:x1876539130037248:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 191us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607489.572733:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00010000:00010000:2.0:1789607489.573532:0:6469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573543:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573557:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573572:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573579:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573585:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607489.573590:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573597:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573609:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607489.573612:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607489.573617:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573623:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbdc62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573635:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573641:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573647:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573652:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607489.573659:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573665:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573672:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78c6f8ca00) 00010000:00010000:2.0:1789607489.573674:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607489.573677:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.573682:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbdc54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607489.574462:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:11410:x1876539130036992:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 16774us (16928us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789607489.574474:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00000020:00080000:2.0:1789607489.574478:0:6469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789607489.574724:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607489.574729:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607489.574752:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789607489.574757:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607489.577745:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607489.578334:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130037504 00000100:00100000:1.0:1789607489.578344:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130037504 00000100:00100000:1.0:1789607489.578425:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607489.578435:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:11410:x1876539130037504:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789607489.579354:0:6472:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789607489.579450:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1789607489.579501:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.579517:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.579529:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.579537:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.579542:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.579549:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607489.579568:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607489.579704:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:11410:x1876539130037504:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 1268us (1966us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789607489.579713:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000020:00080000:1.0:1789607489.579718:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789607489.579777:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607489.579784:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.579791:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607489.579795:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.579811:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.579823:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:2.0:1789607489.579826:0:6457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789607489.579836:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.579843:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdc69 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607489.579856:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607489.579858:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607489.579877:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607489.762517:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607490.052028:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607490.052070:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607490.052106:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607490.052133:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607490.052157:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607490.052290:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130037632 00000100:00100000:3.0:1789607490.052300:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130037632 00000100:00100000:3.0:1789607490.052356:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 379 00000100:00100000:3.0:1789607490.052367:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130037632:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607490.052429:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130037632:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 64us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607490.052437:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 379 00000100:00100000:3.0:1789607490.052467:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130037888 00000100:00100000:3.0:1789607490.052471:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130037888 00000100:00100000:3.0:1789607490.052525:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:3.0:1789607490.052532:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130037888:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607490.052559:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130037888:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607490.052566:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00080000:3.0:1789607490.052582:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607490.052644:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130037760 00000100:00100000:1.0:1789607490.052649:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130037760 00000100:00100000:1.0:1789607490.052689:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130038016 00000100:00100000:1.0:1789607490.052692:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130038016 00000100:00100000:1.0:1789607490.052709:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130038144 00000100:00100000:1.0:1789607490.052711:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130038144 00000100:00100000:1.0:1789607490.052725:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 296 00000100:00100000:1.0:1789607490.052731:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130037760:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607490.052759:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130037760:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.052780:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 296 00000100:00100000:1.0:1789607490.052795:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 297 00000100:00100000:1.0:1789607490.052802:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130038016:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607490.052828:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130038016:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.052834:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 297 00000100:00100000:1.0:1789607490.052847:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 298 00000100:00100000:1.0:1789607490.052853:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130038144:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607490.052912:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130038144:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 59us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.052928:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 298 00000100:00080000:3.0:1789607490.052990:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607490.052993:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607490.274360:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150046720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.274428:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.274476:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150047232:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.274501:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.274522:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150047744:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.274544:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607490.274556:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150046720 00000100:00100000:1.0:1789607490.274562:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150048256:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.274568:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150046720 00000100:00100000:1.0:1789607490.274580:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.274597:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789607490.274602:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150046848:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.274607:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789607490.274615:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150046720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.274625:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.274640:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150047360:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.274659:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150046720:12345-0@lo:400:kworker.0 Request processed in 45us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.274665:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607490.274667:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789607490.274678:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150047872:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.274695:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150046592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607490.274695:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607490.274717:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.274719:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150046720:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.274735:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150047104:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.274747:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047744 00000100:00100000:1.0:1789607490.274750:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047744 00000100:00100000:3.0:1789607490.274752:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607490.274767:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150047616:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.274773:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150048256 00000100:00100000:1.0:1789607490.274775:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150048256 00000100:00100000:3.0:1789607490.274784:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607490.274912:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150048384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607490.274948:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607490.274977:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150046592 00000100:00100000:2.0:1789607490.274980:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150046592 00000100:00100000:3.0:1789607490.275028:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150048128:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.275050:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607490.275148:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150048384 00000100:00100000:2.0:1789607490.275152:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150048384 00000100:00100000:2.0:1789607490.275168:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789607490.275174:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150046592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607490.275191:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789607490.275224:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150046592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607490.275230:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789607490.275244:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789607490.275250:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150048384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607490.275260:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789607490.275285:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150048384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607490.275291:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789607490.275324:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150048384:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789607490.275348:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607490.275358:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150046848 00000100:00100000:2.0:1789607490.275361:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150046848 00000100:00100000:2.0:1789607490.275379:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047360 00000100:00100000:2.0:1789607490.275381:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047360 00000100:00100000:2.0:1789607490.275393:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047872 00000100:00100000:2.0:1789607490.275395:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047872 00000100:00100000:2.0:1789607490.275404:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047104 00000100:00100000:2.0:1789607490.275406:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047104 00000100:00100000:2.0:1789607490.275415:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789607490.275420:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150046848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607490.275447:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150046848:12345-0@lo:400:kworker.0 Request processed in 27us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607490.275452:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789607490.275462:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789607490.275467:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150047360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607490.275486:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150047360:12345-0@lo:400:kworker.0 Request processed in 20us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607490.275491:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789607490.275499:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789607490.275503:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150047872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607490.275521:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150047872:12345-0@lo:400:kworker.0 Request processed in 18us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607490.275526:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789607490.275534:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789607490.275538:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150047104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607490.275556:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150047104:12345-0@lo:400:kworker.0 Request processed in 18us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607490.275567:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:2.0:1789607490.275578:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607490.275593:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150046848:0@lo:400:kworker.0 00000100:00100000:2.0:1789607490.275602:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150047360:0@lo:400:kworker.0 00000100:00100000:2.0:1789607490.275609:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150047872:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.278717:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047616 00000100:00100000:1.0:1789607490.278729:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047616 00000100:00100000:1.0:1789607490.278797:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789607490.278807:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150047744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.279595:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150047744:12345-0@lo:400:kworker.0 Request processed in 787us (5045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.279605:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789607490.279629:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789607490.279637:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150048256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.279680:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150048256:12345-0@lo:400:kworker.0 Request processed in 45us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.279687:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789607490.279699:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789607490.279706:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150047616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.279734:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150047616:12345-0@lo:400:kworker.0 Request processed in 30us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.279740:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789607490.279772:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150046976:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.279813:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.279851:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150047488:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.279893:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.280144:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150048000:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.280169:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607490.280200:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047232 00000100:00100000:1.0:1789607490.280206:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047232 00000100:00100000:1.0:1789607490.280235:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150046976 00000100:00100000:1.0:1789607490.280238:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150046976 00000100:00100000:1.0:1789607490.280251:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789607490.280256:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150047232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.280291:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150047232:12345-0@lo:400:kworker.0 Request processed in 35us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.280297:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789607490.280309:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789607490.280314:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150046976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.280342:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150046976:12345-0@lo:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.280347:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789607490.280366:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150047488 00000100:00100000:1.0:1789607490.280369:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150047488 00000100:00100000:1.0:1789607490.280389:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150048000 00000100:00100000:1.0:1789607490.280391:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150048000 00000100:00100000:1.0:1789607490.280402:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789607490.280408:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150047488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.280436:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150047488:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.280452:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789607490.280464:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789607490.280470:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150048000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.282204:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150048000:12345-0@lo:400:kworker.0 Request processed in 1726us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607490.282219:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789607490.282280:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150046976:0@lo:400:kworker.0 00010000:00080000:1.0:1789607490.282295:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78facc6300 x1876539150047488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607490.282305:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150047488:0@lo:400:kworker.0 00010000:00080000:1.0:1789607490.282316:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d790118f800 x1876539150048000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607490.282323:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150048000:0@lo:400:kworker.0 00000100:00080000:1.0:1789607490.283773:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607490.283781:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607490.283883:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150047232:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.285204:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150047744:0@lo:400:kworker.0 00000100:00100000:1.0:1789607490.285230:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150048256:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.287168:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150048128 00000100:00100000:3.0:1789607490.287182:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150048128 00000100:00100000:3.0:1789607490.287367:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789607490.287380:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150048128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.287885:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150048128:12345-0@lo:400:kworker.0 Request processed in 482us (12807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607490.287895:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789607490.287970:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150048128:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.288008:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150046592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607490.288022:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150047104:0@lo:400:kworker.0 00000100:00100000:3.0:1789607490.288046:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150047616:0@lo:400:kworker.0 00010000:00010000:0.0:1789607490.787437:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607491.179266:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607491.179277:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607491.179324:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789607491.179332:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607491.369395:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607491.369468:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130038400 00000100:00100000:0.0:1789607491.369484:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130038400 00000100:00100000:0.0:1789607491.369580:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:0.0:1789607491.369592:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+18:11428:x1876539130038400:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607491.369626:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607491.369659:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdc70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689a3 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.369799:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdc77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.369817:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdc77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.369834:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdc77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607491.369848:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789607491.370030:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdc70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689a3 expref: 21 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.370051:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdc77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689a3 expref: 20 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.370072:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607491.370076:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789607491.370080:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9600, rc 0) 00000100:00100000:0.0:1789607491.370155:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11428:x1876539130038400:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 565us (778us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789607491.370163:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00080000:0.0:1789607491.370193:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607491.377640:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.377743:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130038528 00000100:00100000:1.0:1789607491.377758:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130038528 00000100:00100000:1.0:1789607491.377843:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:1.0:1789607491.377908:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11428:x1876539130038528:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:1.0:1789607491.378104:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378128:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378143:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378165:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378184:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378192:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378540:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378549:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378557:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607491.378625:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378643:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378665:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378673:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378680:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.378686:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378696:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378713:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607491.378717:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.378724:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378731:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdc85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378750:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378757:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378764:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378770:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.378782:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378791:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378800:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607491.378803:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.378807:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378813:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdc8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378835:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378841:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378846:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378852:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.378854:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378892:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378904:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:1.0:1789607491.378907:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.378927:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.378934:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdc93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607491.379037:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11428:x1876539130038528:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1181us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607491.379047:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:0.0:1789607491.433441:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.433538:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130038784 00000100:00100000:3.0:1789607491.433551:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130038784 00000100:00100000:3.0:1789607491.433625:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:3.0:1789607491.433638:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11431:x1876539130038784:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607491.433667:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607491.433695:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdc9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689aa expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.433811:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.433830:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.433844:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.433889:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.433896:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.433904:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434296:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434306:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434314:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607491.434327:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789607491.434450:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434459:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434467:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434473:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607491.434478:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434487:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434501:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607491.434504:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607491.434510:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434526:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434539:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434545:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434551:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434556:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607491.434558:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434563:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434570:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83200) 00010000:00010000:3.0:1789607491.434572:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607491.434575:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434580:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdca8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434629:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbdc9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 23 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434643:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 22 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.434659:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607491.434662:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607491.434665:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607491.434753:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:11431:x1876539130038784:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1117us (1324us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789607491.434762:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:3.0:1789607491.441408:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607491.442057:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130038912 00000100:00100000:0.0:1789607491.442072:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130038912 00000100:00100000:0.0:1789607491.442155:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:0.0:1789607491.442168:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:11431:x1876539130038912:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607491.442261:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442283:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442299:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442348:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442356:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442386:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442393:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607491.442399:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442408:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442422:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:0.0:1789607491.442425:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607491.442431:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.442438:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdcbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607491.445228:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:11431:x1876539130038912:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 3041us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607491.445248:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 96 00000001:00080000:0.0:1789607491.452847:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:0.0:1789607491.453180:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1789607491.456177:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607491.456252:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130039168 00000100:00100000:0.0:1789607491.456272:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130039168 00000100:00100000:0.0:1789607491.456479:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607491.456496:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0072c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:11431:x1876539130039168:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607491.457132:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0072c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:11431:x1876539130039168:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 638us (961us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789607491.457160:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1789607491.513849:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.514321:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130039424 00000100:00100000:1.0:1789607491.514332:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130039424 00000100:00100000:1.0:1789607491.514386:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:1.0:1789607491.514397:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:10947:x1876539130039424:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607491.514420:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607491.514441:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdcc4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689b1 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.514541:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.514557:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 24 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.514566:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.514598:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 24 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.514610:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 24 pid: 6469 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607491.514631:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150048512:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607491.514718:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607491.518936:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.518969:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130039552 00000100:00100000:3.0:1789607491.518978:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130039552 00010000:00010000:3.0:1789607491.519017:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 25 pid: 6469 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607491.519050:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607491.519060:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:2396:x1876539130039552:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607491.519074:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607491.519081:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 25 pid: 6469 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.519094:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 25 pid: 6469 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.519116:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607491.519121:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.519140:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.519147:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.519166:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607491.519218:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:2396:x1876539130039552:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 159us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607491.519226:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00010000:00010000:1.0:1789607491.519317:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbdcaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689aa expref: 24 pid: 6469 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607491.519334:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150048512:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607491.519355:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.519364:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.519370:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607491.519389:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789607491.519533:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbdcc4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 25 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.519548:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 24 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.519555:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.519558:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789607491.519561:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:1.0:1789607491.519602:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:10947:x1876539130039424:12345-192.168.203.25@tcp:101:bash.0 Request processed in 5208us (5760us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789607491.519621:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:2.0:1789607491.535121:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.535215:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130039808 00000100:00100000:1.0:1789607491.535225:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130039808 00000100:00100000:1.0:1789607491.535283:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:1.0:1789607491.535295:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:10947:x1876539130039808:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:1.0:1789607491.535730:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.535748:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.535761:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607491.535813:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789607491.535839:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb6c249 reply state 0000000090068f39 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.535852:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.535984:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.535988:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607491.535993:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789607491.536047:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789607491.536192:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:10947:x1876539130039808:12345-192.168.203.25@tcp:36:bash.0 Request processed in 898us (1078us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789607491.536200:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 98 00000020:00080000:1.0:1789607491.536206:0:12196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789607491.539263:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607491.539353:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130039936 00000100:00100000:0.0:1789607491.539363:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130039936 00000100:00100000:0.0:1789607491.539422:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:0.0:1789607491.539433:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:10947:x1876539130039936:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607491.539458:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607491.539478:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdce0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689b8 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.539538:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdce0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b8 expref: 29 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.539552:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdce0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b8 expref: 29 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.539571:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:0.0:1789607491.539574:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607491.539578:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8a00, rc 0) 00000100:00100000:0.0:1789607491.539640:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:10947:x1876539130039936:12345-192.168.203.25@tcp:101:bash.0 Request processed in 208us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607491.539647:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:2.0:1789607491.546291:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.546387:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130040064 00000100:00100000:1.0:1789607491.546398:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130040064 00000100:00100000:1.0:1789607491.546463:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:1.0:1789607491.546480:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:10947:x1876539130040064:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607491.546498:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607491.546520:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689bf expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607491.546547:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aab3e40, atime: 0x6aab3e3e, ctime: 0x6aab3e40, blocks: 0xb 00010000:00010000:1.0:1789607491.546573:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1789607491.546578:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607491.546586:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.546604:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.546625:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185600, rc 0) 00000100:00100000:1.0:1789607491.546683:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:10947:x1876539130040064:12345-192.168.203.25@tcp:101:bash.0 Request processed in 211us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607491.546689:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00080000:2.0:1789607491.546984:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607491.549788:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.549896:0:8117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130040192 00000100:00100000:1.0:1789607491.549906:0:8117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130040192 00002000:00010000:1.0:1789607491.549955:0:8117:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789607491.549960:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fcd5c000 with x1876539130040192 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607491.549971:0:8117:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fcd5c000. 00000100:00100000:1.0:1789607491.550002:0:8117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:1.0:1789607491.550026:0:8117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130040192:12345-192.168.203.25@tcp:10:bash.0 00002000:00010000:1.0:1789607491.550308:0:8117:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789607491.550312:0:8117:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789607488 -> 1789607492 00002000:00010000:1.0:1789607491.550315:0:8117:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789607486 -> 1789607486 00002000:00010000:1.0:1789607491.550317:0:8117:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789607488 -> 1789607492 00002000:00010000:1.0:1789607491.550320:0:8117:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789607491.550383:0:8117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130040192:12345-192.168.203.25@tcp:10:bash.0 Request processed in 359us (603us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789607491.550390:0:8117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00002000:00010000:1.0:1789607491.550393:0:8117:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1789607491.550396:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fcd5c000 with x1876539130040192 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607491.550401:0:8117:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fcd5c000. 00000100:00100000:3.0:1789607491.623202:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.623358:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130040320 00000100:00100000:1.0:1789607491.623368:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130040320 00000100:00100000:1.0:1789607491.623427:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:1.0:1789607491.623437:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:11445:x1876539130040320:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:1.0:1789607491.623512:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623529:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623540:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623556:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623581:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623588:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623817:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623827:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.623834:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607491.624253:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624266:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624272:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624278:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624284:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.624287:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624294:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624315:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607491.624318:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.624323:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624329:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdcee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624344:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624350:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624355:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624360:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.624362:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624367:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624374:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607491.624376:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.624379:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624385:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdcf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624413:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624418:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624423:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624429:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.624431:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624438:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624445:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.624448:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.624450:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.624456:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdcfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607491.624539:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:11445:x1876539130040320:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1101us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607491.624547:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:3.0:1789607491.672037:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.672274:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130040576 00000100:00100000:1.0:1789607491.672283:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130040576 00000100:00100000:1.0:1789607491.672377:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:1.0:1789607491.672410:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:11448:x1876539130040576:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607491.672430:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607491.672450:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689c6 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672538:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672554:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672565:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672580:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672587:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672594:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672831:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672841:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.672848:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607491.672905:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789607491.673421:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673429:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673435:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673440:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.673444:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673452:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673463:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607491.673466:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.673470:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673476:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673489:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673495:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673513:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673519:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.673522:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673528:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673535:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607491.673538:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.673541:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673547:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673595:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689c6 expref: 32 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673611:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689c6 expref: 31 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.673617:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.673619:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789607491.673622:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185400, rc 0) 00000100:00100000:1.0:1789607491.673695:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11448:x1876539130040576:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1287us (1787us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789607491.673711:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:2.0:1789607491.677935:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.678207:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130040704 00000100:00100000:3.0:1789607491.678217:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130040704 00000100:00100000:3.0:1789607491.678274:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:3.0:1789607491.678284:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11448:x1876539130040704:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1789607491.678348:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.678367:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 31 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.678376:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.678420:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 31 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.678454:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 31 pid: 6468 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607491.678469:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa629880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150048640:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607491.678548:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607491.681334:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa629880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150048640:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607491.681363:0:6469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607491.683201:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.683458:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130040960 00000100:00100000:3.0:1789607491.683468:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130040960 00000100:00100000:3.0:1789607491.683525:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1789607491.683535:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:6370:x1876539130040960:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789607491.683848:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:6370:x1876539130040960:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 314us (653us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789607491.683857:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1789607491.687201:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.687352:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130041088 00000100:00100000:1.0:1789607491.687362:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130041088 00010000:00010000:1.0:1789607491.687399:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 33 pid: 6468 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607491.687437:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:1.0:1789607491.687447:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:2395:x1876539130041088:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607491.687462:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607491.687470:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 33 pid: 6468 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.687482:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 33 pid: 6468 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.687506:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdccb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b1 expref: 33 pid: 6468 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.687524:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.687529:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.687539:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.687561:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.687598:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607491.687657:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:2395:x1876539130041088:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 210us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607491.687664:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00010000:00010000:2.0:1789607491.687733:0:6469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687742:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687770:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687779:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687785:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687802:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607491.687807:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687815:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687824:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:2.0:1789607491.687827:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607491.687831:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.687837:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbdd26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607491.687939:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11448:x1876539130040704:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 9656us (10013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607491.687948:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:2.0:1789607491.690582:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.690694:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130041344 00000100:00100000:3.0:1789607491.690704:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130041344 00000100:00100000:3.0:1789607491.690756:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:3.0:1789607491.690765:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:11448:x1876539130041344:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607491.691281:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:11448:x1876539130041344:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 515us (706us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789607491.691290:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1789607491.765477:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.765683:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130041600 00000100:00100000:1.0:1789607491.765693:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130041600 00000100:00100000:1.0:1789607491.765749:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:1.0:1789607491.765759:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:11459:x1876539130041600:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:1.0:1789607491.765783:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607491.765803:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689cd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.765921:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.765936:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.765947:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.765961:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.765969:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.765995:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766521:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766531:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766538:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607491.766549:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789607491.766637:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766645:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766652:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766658:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.766662:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766669:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766680:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607491.766683:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.766695:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766702:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766715:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766721:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766726:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766730:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.766733:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766738:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766746:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607491.766747:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.766750:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766755:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766798:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689cd expref: 35 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766821:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689cd expref: 34 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.766829:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.766831:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607491.766833:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607491.767158:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11459:x1876539130041600:12345-192.168.203.25@tcp:101:cat.0 Request processed in 1400us (1690us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789607491.767167:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:2.0:1789607491.773836:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607491.774442:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130041856 00000100:00100000:0.0:1789607491.774452:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130041856 00000100:00100000:0.0:1789607491.774546:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:0.0:1789607491.774557:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11459:x1876539130041856:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:0.0:1789607491.774799:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:11459:x1876539130041856:12345-192.168.203.25@tcp:35:cat.0 Request processed in 243us (972us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789607491.774807:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:2.0:1789607491.807561:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.808373:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130042112 00000100:00100000:1.0:1789607491.808384:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130042112 00000100:00100000:1.0:1789607491.808497:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 104 00000100:00100000:1.0:1789607491.808508:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:11460:x1876539130042112:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:1.0:1789607491.808560:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789607491.808585:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689cd expref: 35 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808608:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689c6 expref: 34 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808622:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdce0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689b8 expref: 33 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808633:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.808639:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607491.808676:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808690:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808700:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808714:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808720:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.808727:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809032:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809042:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809050:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607491.809684:0:12196:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789607491.809695:0:12196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396766832642ns, next at 397766829804ns, rc = 0 00010000:00010000:1.0:1789607491.809755:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809765:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809783:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809791:0:12196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809797:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809804:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809827:0:12196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607491.809849:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809856:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.809894:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607491.809894:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809900:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607491.809901:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809904:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.809919:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607491.809922:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809925:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.809929:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809935:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607491.809939:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789607491.809946:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809952:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd5e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809970:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809976:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809982:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809987:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.809991:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.809997:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.810004:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607491.810007:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.810010:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.810016:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.810024:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00000004:00010000:1.0:1789607491.810026:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b80786b1 reply state 000000007c37dbf3 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.810027:0:6457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789607491.810030:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.810036:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbdd65 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.810047:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607491.810047:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607491.810048:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607491.810050:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607491.810054:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607491.810056:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607491.810058:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607491.810141:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11460:x1876539130042112:12345-192.168.203.25@tcp:36:rm.0 Request processed in 1632us (3764us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789607491.810150:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 104 00010000:00010000:2.0:1789607491.813078:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607491.875781:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607491.875838:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130042368 00000100:00100000:1.0:1789607491.875848:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130042368 00000100:00100000:1.0:1789607491.876022:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 105 00000100:00100000:1.0:1789607491.876033:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:11466:x1876539130042368:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607491.876184:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607491.876205:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689d4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.876317:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.876332:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.876343:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.876354:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.876380:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.876387:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607491.876841:0:6469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789607491.877292:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877304:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877313:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877346:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877353:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877360:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877366:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607491.877370:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877378:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877402:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607491.877405:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607491.877410:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877417:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdd73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607491.877432:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6aa6ff0 reply state 0000000030633624 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877443:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877450:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607491.877452:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607491.877456:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607491.877486:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 37 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877501:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 36 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607491.877509:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:1.0:1789607491.877511:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607491.877513:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607491.877579:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:11466:x1876539130042368:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1547us (1804us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789607491.877587:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 105 00000100:00100000:2.0:1789607491.881544:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.881719:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130042496 00000100:00100000:3.0:1789607491.881729:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130042496 00000100:00100000:3.0:1789607491.881819:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1789607491.881830:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130042496:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1789607491.881921:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607491.881947:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689db expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607491.881973:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789607491.881990:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1789607491.881995:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607491.882004:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 6 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.882023:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 6 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.882036:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607491.882321:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130042496:12345-192.168.203.25@tcp:101:bash.0 Request processed in 491us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607491.882329:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:2.0:1789607491.889511:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607491.889611:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130042624 00000100:00100000:0.0:1789607491.889621:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130042624 00000100:00100000:0.0:1789607491.889705:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1789607491.889715:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:11466:x1876539130042624:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607491.889733:0:9649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607491.889750:0:9649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689e2 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.889783:0:9649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 7 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.889791:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607491.889795:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607491.889800:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 7 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.889833:0:9649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 7 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.889846:0:9649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 7 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607491.889990:0:9649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9649:1876539150048768:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607491.890178:0:9649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607491.895191:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.895421:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130042752 00000100:00100000:3.0:1789607491.895432:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130042752 00010000:00010000:3.0:1789607491.895472:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 8 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607491.895522:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:3.0:1789607491.895532:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130042752:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607491.895548:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607491.895583:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 8 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.895598:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 8 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.895631:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607491.895635:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607491.895643:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 8 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.895654:0:6456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 8 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607491.895692:0:6456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 8 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607491.895706:0:6456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa628700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150048896:192.168.203.25@tcp:105: 00000100:00100000:3.0:1789607491.895789:0:6456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789607491.896693:0:9649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbdd8f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689db expref: 8 pid: 8114 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607491.896713:0:9649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9649:1876539150048768:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607491.896737:0:9649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 7 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607491.896748:0:9649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8400, rc 0) 00000100:00100000:0.0:1789607491.896837:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:11466:x1876539130042624:12345-192.168.203.25@tcp:101:bash.0 Request processed in 7123us (7334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607491.896844:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1789607491.898850:0:6456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa628700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150048896:192.168.203.25@tcp:105: 00010000:00010000:0.0:1789607491.900560:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607491.900639:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130042752:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 5102us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607491.900651:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:2.0:1789607491.901719:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607491.901806:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130043008 00000100:00100000:3.0:1789607491.901816:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130043008 00000100:00100000:0.0:1789607491.902140:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1789607491.902152:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:11466:x1876539130043008:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:0.0:1789607491.902596:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:11466:x1876539130043008:12345-192.168.203.25@tcp:35:bash.0 Request processed in 445us (880us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789607491.902604:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607492.080005:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.080193:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130043136 00000100:00100000:1.0:1789607492.080203:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130043136 00000100:00100000:1.0:1789607492.080271:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 106 00000100:00100000:1.0:1789607492.080282:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:11482:x1876539130043136:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607492.080306:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607492.080327:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689e9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.080495:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdda4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.080509:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdda4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.080523:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdda4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607492.080558:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789607492.080562:0:6468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607492.080583:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdda4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.080607:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdd9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e9 expref: 40 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.080626:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdda4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e9 expref: 39 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.080634:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607492.080637:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607492.080654:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184a00, rc 0) 00000100:00100000:1.0:1789607492.082022:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+39:11482:x1876539130043136:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1734us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.082032:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 106 00000100:00100000:2.0:1789607492.091842:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.092079:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130043392 00000100:00100000:1.0:1789607492.092089:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130043392 00000100:00100000:1.0:1789607492.092154:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:1.0:1789607492.092165:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+39:11482:x1876539130043392:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607492.092186:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607492.092207:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbddab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689f0 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.092308:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbddb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.092322:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbddb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.092334:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbddb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607492.092346:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789607492.092483:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbddab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f0 expref: 42 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.092503:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbddb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f0 expref: 41 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.092511:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:1.0:1789607492.092529:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607492.092533:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184600, rc 0) 00000100:00100000:1.0:1789607492.092595:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:11482:x1876539130043392:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 432us (761us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789607492.092601:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:2.0:1789607492.101316:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.101399:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130043648 00000100:00100000:1.0:1789607492.101408:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130043648 00000100:00100000:1.0:1789607492.101465:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:1.0:1789607492.101475:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:11482:x1876539130043648:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607492.101498:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607492.101518:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbddc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689f7 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.101607:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbddc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.101621:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbddc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.101633:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbddc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607492.101646:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789607492.101758:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbddc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f7 expref: 44 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.101776:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbddc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f7 expref: 43 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.101803:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:1.0:1789607492.101806:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789607492.101809:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185000, rc 0) 00000100:00100000:1.0:1789607492.101977:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:11482:x1876539130043648:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 502us (670us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789607492.101984:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:2.0:1789607492.111119:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.111357:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130043776 00000100:00100000:1.0:1789607492.111366:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130043776 00000100:00100000:1.0:1789607492.111441:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607492.111452:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:2393:x1876539130043776:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607492.111470:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607492.111496:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbddb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f0 expref: 43 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.111516:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:1.0:1789607492.111521:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607492.111575:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+42:2393:x1876539130043776:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 125us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.111582:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1789607492.117282:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.117361:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130043904 00000100:00100000:1.0:1789607492.117370:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130043904 00000100:00100000:1.0:1789607492.117443:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1789607492.117453:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130043904:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:1.0:1789607492.117500:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.117532:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 6 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.117540:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789607492.117545:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607492.117549:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.117584:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 6 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.117599:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 6 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607492.117614:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150049024:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607492.117713:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370d80 going to sleep for 11 seconds 00000100:00080000:2.0:1789607492.119348:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607492.119697:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150049024:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607492.119723:0:8112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.121095:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.121177:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130044032 00000100:00100000:1.0:1789607492.121187:0:8119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130044032 00002000:00100000:1.0:1789607492.121237:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d78fd117b80 x1876539130044032/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:48/0 lens 504/0 e 0 to 0 dl 1789607503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607492.121271:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fd117b80 with x1876539130044032 ext(0->8) 00010000:00010000:1.0:1789607492.121280:0:8119:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 7 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.121297:0:8119:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 7 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607492.121305:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d78fd117b80 00000100:00100000:1.0:1789607492.121342:0:8119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:1.0:1789607492.121352:0:8119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130044032:12345-192.168.203.25@tcp:4:lfs.0 00000100:00100000:1.0:1789607492.121920:0:8119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2393:x1876539130044032:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 510us (774us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789607492.121929:0:8119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00002000:00100000:1.0:1789607492.121937:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d78fd117b80 x1876539130044032/t4294967303(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:48/0 lens 504/448 e 0 to 0 dl 1789607503 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607492.121945:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fd117b80 with x1876539130044032 ext(0->8) 00010000:00010000:1.0:1789607492.121951:0:8119:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 9 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.121965:0:8119:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 9 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607492.121972:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d78fd117b80 00000100:00100000:2.0:1789607492.124297:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.124427:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130044160 00000100:00100000:1.0:1789607492.124447:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130044160 00010000:00010000:1.0:1789607492.124482:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 9 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607492.124522:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:1.0:1789607492.124531:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2394:x1876539130044160:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607492.124547:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789607492.124565:0:7268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789607492.124568:0:7268:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789607492 00002000:00010000:1.0:1789607492.124570:0:7268:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789607492 00002000:00010000:1.0:1789607492.124572:0:7268:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789607492 00010000:00010000:1.0:1789607492.124579:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 9 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.124592:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 9 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.124616:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbdd96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e2 expref: 9 pid: 9649 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.124633:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607492.124637:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607492.124642:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.124652:0:7268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.124739:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607492.124795:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130044160:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 263us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.124802:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00010000:00010000:2.0:1789607492.125352:0:8112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125365:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125399:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125408:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125415:0:8112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125422:0:8112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607492.125427:0:8112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125435:0:8112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125447:0:8112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.125646:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbddd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.125788:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130043904:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 8334us (8513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.125797:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:2.0:1789607492.128240:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.128505:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130044416 00000100:00100000:3.0:1789607492.128516:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130044416 00000100:00100000:3.0:1789607492.128575:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1789607492.128586:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0072450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+42:11482:x1876539130044416:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:3.0:1789607492.128647:0:6472:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbddc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f7 expref: 42 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607492.131788:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789607492.132154:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789607492.132624:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1789607492.132684:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.132705:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 46 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.132714:0:6472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.132750:0:6472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 46 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.132766:0:6472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 46 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.132779:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa62b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6472:1876539150049152:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607492.132951:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607492.136032:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.136064:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa62b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6472:1876539150049152:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607492.136092:0:6472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607492.136135:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130044544 00000100:00100000:1.0:1789607492.136142:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130044544 00010000:00010000:1.0:1789607492.136177:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 47 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607492.136205:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1789607492.136214:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:2395:x1876539130044544:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607492.136228:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607492.136234:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 47 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.136246:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 47 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.136266:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdd81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689d4 expref: 47 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.136282:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:1.0:1789607492.136287:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.136295:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.136316:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.136352:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607492.136454:0:6472:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.136468:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607492.136584:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789607492.136768:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789607492.136931:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6472:1876539150049280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789607492.136975:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607492.137003:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607492.137021:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150049280 00000100:00100000:0.0:1789607492.137025:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150049280 00000100:00100000:0.0:1789607492.137069:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789607492.137076:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1876539150049280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1789607492.137118:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607492.137148:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6472:x1876539150049280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.137156:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789607492.137176:0:6472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789607492.137182:0:6472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000100:00100000:1.0:1789607492.137196:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+48:2395:x1876539130044544:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 981us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.137206:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000004:00080000:3.0:1789607492.137209:0:6472:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78e9d94380, transno 4294967302 00000100:00100000:3.0:1789607492.137235:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6472:1876539150049280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789607492.138849:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789607492.138960:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa62b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6472:1876539150049408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789607492.139011:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607492.139044:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607492.139414:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150049408 00000100:00100000:1.0:1789607492.139422:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150049408 00000100:00100000:1.0:1789607492.139470:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789607492.139478:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6472:x1876539150049408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789607492.139655:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6472:x1876539150049408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 176us (643us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789607492.139663:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789607492.140805:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa62b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6472:1876539150049408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789607492.140901:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789607492.140963:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.140975:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.140983:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.140989:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.140993:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.141001:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.141016:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:3.0:1789607492.141019:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789607492.141023:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.141029:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbdddc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607492.141585:0:6472:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789607492.142949:0:6472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789607492.142965:0:6472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397100102612ns, next at 398100100016ns, rc = 0 00000001:00080000:3.0:1789607492.142977:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789607492.143033:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:3.0:1789607492.143037:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789607492.143048:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbddc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689f7 expref: 50 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.143176:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0072450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+49:11482:x1876539130044416:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 14591us (14943us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789607492.143185:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000020:00080000:3.0:1789607492.143190:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789607492.149419:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.149646:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130044672 00000100:00100000:1.0:1789607492.149655:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130044672 00000100:00100000:1.0:1789607492.149715:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 109 00000100:00100000:1.0:1789607492.149725:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+49:11482:x1876539130044672:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607492.149750:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607492.149783:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdde3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e6689fe expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.149840:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdde3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689fe expref: 50 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.149855:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdde3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689fe expref: 50 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.149937:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:1.0:1789607492.149940:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607492.149943:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607492.149993:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:11482:x1876539130044672:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 269us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.150000:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 109 00000100:00100000:2.0:1789607492.153661:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.153752:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130044928 00000100:00100000:0.0:1789607492.153761:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130044928 00000100:00100000:0.0:1789607492.153807:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1789607492.153817:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:11482:x1876539130044928:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607492.154343:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:11482:x1876539130044928:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 526us (691us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789607492.154352:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:2.0:1789607492.253000:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.253142:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130045056 00000100:00100000:0.0:1789607492.253151:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130045056 00000100:00100000:0.0:1789607492.253224:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 110 00000100:00100000:0.0:1789607492.253249:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:11492:x1876539130045056:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1789607492.253323:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253340:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253353:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253364:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253371:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253377:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253471:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253479:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253486:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607492.253526:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253539:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253552:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253558:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253564:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607492.253568:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253576:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253588:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607492.253591:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607492.253596:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253602:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbddea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253614:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253619:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253624:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253642:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607492.253651:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253658:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253666:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:0.0:1789607492.253668:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607492.253671:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253676:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbddf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253686:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253691:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253696:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253701:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607492.253703:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253709:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253716:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607492.253718:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607492.253727:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.253733:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbddf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.253807:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:11492:x1876539130045056:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 560us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.253815:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 110 00000100:00100000:2.0:1789607492.296837:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.297525:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130045312 00000100:00100000:3.0:1789607492.297536:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130045312 00000100:00100000:3.0:1789607492.297603:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 111 00000100:00100000:3.0:1789607492.297613:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:11495:x1876539130045312:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607492.297634:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607492.297654:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbddff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a05 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.297724:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.297739:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.297751:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.297777:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.297786:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.297792:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298429:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298441:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298448:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607492.298457:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789607492.298543:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298549:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298556:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298562:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.298566:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298584:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298596:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607492.298598:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607492.298604:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298610:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298622:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298628:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298633:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298637:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.298639:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298645:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298652:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:3.0:1789607492.298655:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607492.298658:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298672:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298711:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbddff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 54 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298726:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 53 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.298733:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.298735:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607492.298738:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607492.298853:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:11495:x1876539130045312:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1240us (2024us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789607492.298899:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 111 00000100:00100000:2.0:1789607492.302327:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.302428:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130045440 00000100:00100000:0.0:1789607492.302437:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130045440 00000100:00100000:0.0:1789607492.302535:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:0.0:1789607492.302546:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:11495:x1876539130045440:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607492.302611:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302627:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302638:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302664:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302671:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302678:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302684:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607492.302700:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302708:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302720:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607492.302724:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607492.302728:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.302735:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.302848:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:11495:x1876539130045440:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 305us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.302857:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:2.0:1789607492.307099:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.307249:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130045696 00000100:00100000:3.0:1789607492.307259:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130045696 00000100:00100000:3.0:1789607492.307311:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:3.0:1789607492.307321:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:11495:x1876539130045696:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607492.307540:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:11495:x1876539130045696:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 219us (449us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789607492.307547:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:3.0:1789607492.326495:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607492.326522:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150049536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607492.326588:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607492.326777:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150049536 00000100:00100000:2.0:1789607492.326786:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150049536 00000100:00100000:2.0:1789607492.326851:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789607492.326890:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150049536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607492.326920:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607492.326970:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150049536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.326976:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789607492.327023:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150049536:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789607492.327183:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607492.327482:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607492.327495:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150049664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607492.327528:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607492.327611:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150049664 00000100:00100000:0.0:1789607492.327617:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150049664 00000100:00100000:0.0:1789607492.327656:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789607492.327665:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150049664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607492.327678:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607492.327727:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150049664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.327733:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789607492.327804:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150049664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607492.399616:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.399714:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130045952 00000100:00100000:0.0:1789607492.399725:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130045952 00000100:00100000:0.0:1789607492.399791:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:0.0:1789607492.399803:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:11505:x1876539130045952:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607492.399894:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607492.399898:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789607492.399934:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdda4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689e9 expref: 54 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.399953:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607492.399958:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607492.399970:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a0c expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.400076:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.400090:0:7709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 54 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.400099:0:7709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.400134:0:7709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 54 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.400148:0:7709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 54 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.400162:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150049792:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607492.400246:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607492.404617:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150049792:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.404667:0:7709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.405242:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.405324:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130046080 00000100:00100000:0.0:1789607492.405333:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130046080 00010000:00010000:0.0:1789607492.405370:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 55 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.405412:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:0.0:1789607492.405423:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:2395:x1876539130046080:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607492.405439:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607492.405446:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 55 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.405459:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 55 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.405495:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbde14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a05 expref: 55 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.405511:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607492.405521:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.405530:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.405538:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.405573:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607492.405609:0:7709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.405617:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.405629:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:2395:x1876539130046080:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 208us (390us total) trans 0 rc 0/0 00000004:00200000:2.0:1789607492.405634:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:0.0:1789607492.405636:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00010000:00010000:2.0:1789607492.405775:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 55 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.405789:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 54 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.405803:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:2.0:1789607492.405807:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607492.405809:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9000, rc 0) 00000100:00100000:2.0:1789607492.405835:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:11505:x1876539130045952:12345-192.168.203.25@tcp:101:bash.0 Request processed in 6035us (6236us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789607492.405842:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:2.0:1789607492.414641:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.414781:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130046336 00000100:00100000:3.0:1789607492.414792:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130046336 00000100:00100000:3.0:1789607492.415020:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:3.0:1789607492.415032:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:11505:x1876539130046336:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:3.0:1789607492.415293:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.415311:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.415323:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607492.415373:0:6470:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789607492.415397:0:6470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057a52549 reply state 00000000fc847c65 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.415409:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.415416:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.415419:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607492.415423:0:6470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607492.415716:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11505:x1876539130046336:12345-192.168.203.25@tcp:36:bash.0 Request processed in 685us (1084us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789607492.415724:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 114 00000020:00080000:3.0:1789607492.415730:0:6470:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789607492.424186:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.424306:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130046464 00000100:00100000:0.0:1789607492.424316:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130046464 00000100:00100000:0.0:1789607492.424407:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:0.0:1789607492.424417:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11505:x1876539130046464:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607492.424443:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607492.424463:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbde45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a13 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.424567:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.424582:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 58 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.424592:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.424627:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 58 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.424640:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 58 pid: 7709 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.424655:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150049920:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607492.424754:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607492.431079:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150049920:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.431110:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607492.433198:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.433285:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130046592 00000100:00100000:3.0:1789607492.433296:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130046592 00010000:00010000:3.0:1789607492.433340:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 59 pid: 7709 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.433413:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:3.0:1789607492.433423:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:2396:x1876539130046592:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607492.433439:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.433446:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 59 pid: 7709 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.433459:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 59 pid: 7709 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.433481:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a0c expref: 59 pid: 7709 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.433498:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.433504:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.433513:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.433521:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.433567:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607492.433626:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.433627:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:2396:x1876539130046592:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 205us (437us total) trans 0 rc 0/0 00010000:00010000:0.0:1789607492.433644:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.433645:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000004:00200000:0.0:1789607492.433820:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789607492.433825:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607492.433951:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.433984:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbde45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 58 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.434000:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 57 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.434008:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607492.434012:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607492.434015:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8800, rc 0) 00000100:00100000:0.0:1789607492.434045:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11505:x1876539130046464:12345-192.168.203.25@tcp:101:bash.0 Request processed in 9630us (9870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.434052:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:1.0:1789607492.439402:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.440682:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130046848 00000100:00100000:3.0:1789607492.440696:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130046848 00000100:00100000:3.0:1789607492.440761:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:3.0:1789607492.440772:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:11505:x1876539130046848:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:3.0:1789607492.441793:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11505:x1876539130046848:12345-192.168.203.25@tcp:35:bash.0 Request processed in 1017us (2394us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789607492.441803:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:2.0:1789607492.513357:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.513672:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130046976 00000100:00100000:0.0:1789607492.513696:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130046976 00000100:00100000:0.0:1789607492.513768:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:0.0:1789607492.513780:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:11511:x1876539130046976:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607492.513806:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607492.513827:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbde53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a1a expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.513937:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.513952:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.513963:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607492.513999:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789607492.514003:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607492.514026:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.514062:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbde53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a1a expref: 60 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.514080:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a1a expref: 59 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.514088:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607492.514091:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607492.514094:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9000, rc 0) 00000100:00100000:0.0:1789607492.514168:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11511:x1876539130046976:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 391us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.514176:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:2.0:1789607492.516975:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.517070:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130047104 00000100:00100000:3.0:1789607492.517082:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130047104 00000100:00100000:3.0:1789607492.517143:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:3.0:1789607492.517155:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11511:x1876539130047104:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607492.517178:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607492.517200:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a21 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517265:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517281:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517292:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517307:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517314:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517337:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517429:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517439:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517445:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607492.517484:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789607492.517488:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607492.517506:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517518:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517527:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517533:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517540:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517546:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.517550:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517564:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517576:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607492.517579:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607492.517584:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517590:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbde68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517602:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517608:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517614:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517619:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.517622:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517628:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517635:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:3.0:1789607492.517638:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607492.517641:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517659:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517688:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 61 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517700:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 60 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.517708:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.517710:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607492.517713:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607492.517777:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11511:x1876539130047104:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 625us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.517785:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:2.0:1789607492.522755:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.522806:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.522938:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130047360 00000100:00100000:0.0:1789607492.522948:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130047360 00000100:00100000:0.0:1789607492.523009:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:0.0:1789607492.523021:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11511:x1876539130047360:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607492.523043:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607492.523078:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbde7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a28 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523194:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523210:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 61 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523217:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 61 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523225:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523259:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 61 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523273:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 61 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.523307:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150050048:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.523404:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 61 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.523413:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 61 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.523422:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150050176:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607492.523444:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607492.525509:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130047488 00000100:00100000:3.0:1789607492.525524:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130047488 00010000:00010000:3.0:1789607492.525572:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 62 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.525604:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:3.0:1789607492.525613:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:2395:x1876539130047488:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607492.525627:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.525635:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 62 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.525665:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 62 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.525688:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.525694:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.525703:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.525709:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607492.525780:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:2395:x1876539130047488:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 167us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.525787:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:2.0:1789607492.527920:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.528266:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130047616 00000100:00100000:3.0:1789607492.528275:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130047616 00010000:00010000:3.0:1789607492.528315:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 62 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.528347:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:3.0:1789607492.528356:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:2396:x1876539130047616:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607492.528369:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.528376:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 62 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.528390:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 62 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.528427:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.528432:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.528441:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.528450:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.528469:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607492.528520:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:2396:x1876539130047616:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 165us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.528527:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00010000:00010000:0.0:1789607492.528928:0:12196:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.25@tcp) returned -22 from blocking AST (req@0000000040886fdc x1876539150050048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 61 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.528944:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbde76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a21 expref: 61 pid: 6470 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.528959:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150050048:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.528973:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbde4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a13 expref: 60 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.528982:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150050176:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.529000:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607492.529007:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.529027:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.529034:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607492.529063:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789607492.529206:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbde7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 61 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.529221:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 60 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.529228:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607492.529231:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789607492.529233:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:0.0:1789607492.529266:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11511:x1876539130047360:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 6248us (6521us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789607492.529273:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:2.0:1789607492.533114:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.533205:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130047872 00000100:00100000:3.0:1789607492.533218:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130047872 00000100:00100000:3.0:1789607492.533291:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:3.0:1789607492.533302:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11511:x1876539130047872:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:3.0:1789607492.533318:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.533345:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdde3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689fe expref: 60 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.533368:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.533373:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607492.533430:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11511:x1876539130047872:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 130us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.533438:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1789607492.539607:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.540068:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130048000 00000100:00100000:3.0:1789607492.540078:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130048000 00000100:00100000:3.0:1789607492.540134:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:3.0:1789607492.540144:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11511:x1876539130048000:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:3.0:1789607492.540265:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.540285:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.540297:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607492.540593:0:6469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789607492.540687:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11511:x1876539130048000:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 542us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.540695:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:2.0:1789607492.552492:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.552693:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130048128 00000100:00100000:3.0:1789607492.552705:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130048128 00000100:00100000:3.0:1789607492.552773:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:3.0:1789607492.552785:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:11511:x1876539130048128:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607492.552804:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607492.552824:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a2f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.552932:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.552945:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 60 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.552977:0:6470:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.552991:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 60 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.553005:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.553008:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607492.553011:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 60 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.553019:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f400, rc 0) 00000100:00100000:3.0:1789607492.553088:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11511:x1876539130048128:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 305us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.553094:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000040:00080000:1.0:1789607492.642222:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607492.642232:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607492.642292:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789607492.642299:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607492.642423:0:13335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150050304:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607492.642517:0:13335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607492.647136:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.647375:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130048256 00000100:00100000:0.0:1789607492.647385:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130048256 00000100:00100000:0.0:1789607492.647452:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:0.0:1789607492.647463:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130048256:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607492.647495:0:12196:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607492.647603:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130048256:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 142us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.647611:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:1.0:1789607492.647830:0:13335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150050304:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607492.650228:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.650423:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130048384 00000100:00100000:2.0:1789607492.650433:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130048384 00000100:00100000:2.0:1789607492.650484:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:2.0:1789607492.650493:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11513:x1876539130048384:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789607492.650563:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650579:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650591:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650621:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650629:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650637:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650661:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650669:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650675:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607492.650716:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789607492.650721:0:6468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607492.650733:0:6468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650744:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650751:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650758:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650788:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607492.650792:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650800:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650812:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:2.0:1789607492.650815:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607492.650819:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650825:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdea0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650838:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650844:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650850:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650854:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607492.650857:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650925:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650945:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8d78c6f8c400) 00010000:00010000:2.0:1789607492.650948:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607492.650951:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650958:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdea7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650972:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650978:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650984:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650988:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607492.650991:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.650996:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.651004:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:2.0:1789607492.651006:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607492.651009:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.651015:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.651103:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11513:x1876539130048384:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 611us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.651110:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:0.0:1789607492.660837:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.665223:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130048640 00000100:00100000:2.0:1789607492.665239:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130048640 00000100:00100000:2.0:1789607492.665314:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:2.0:1789607492.665327:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:11513:x1876539130048640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607492.665350:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607492.665372:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeb5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a36 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665472:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665488:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665501:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607492.665513:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789607492.665615:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665624:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665631:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665656:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607492.665661:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665668:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665681:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:2.0:1789607492.665684:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789607492.665689:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665695:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdebc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665738:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeb5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a36 expref: 62 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.665749:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:2.0:1789607492.665752:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607492.665756:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbdeb5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a36 expref: 62 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.667207:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581800, rc 0) 00000100:00100000:2.0:1789607492.667345:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130048640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 2018us (6516us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789607492.667354:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:0.0:1789607492.676662:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.676747:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130048768 00000100:00100000:1.0:1789607492.676756:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130048768 00000100:00100000:1.0:1789607492.676823:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:1.0:1789607492.676834:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130048768:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789607492.676908:0:6469:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789607492.677305:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130048768:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 472us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.677314:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:3.0:1789607492.680796:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.681198:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130049024 00000100:00100000:1.0:1789607492.681209:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130049024 00000100:00100000:1.0:1789607492.681268:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:1.0:1789607492.681280:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130049024:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607492.681300:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607492.681303:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789607492.681331:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbde5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a1a expref: 61 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.681350:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:1.0:1789607492.681356:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607492.681370:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdeca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a3d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607492.681778:0:6470:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789607492.682060:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbded1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.682075:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbded1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.682086:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbded1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.682139:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdeca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a3d expref: 63 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.682173:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbded1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a3d expref: 62 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.682182:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4100) 00010000:00010000:1.0:1789607492.682185:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607492.682187:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184600, rc 0) 00000100:00100000:1.0:1789607492.682243:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:11513:x1876539130049024:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 965us (1457us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789607492.682251:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:0.0:1789607492.686803:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.686906:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130049280 00000100:00100000:2.0:1789607492.686930:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130049280 00000100:00100000:2.0:1789607492.686992:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:2.0:1789607492.687002:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:11513:x1876539130049280:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789607492.687067:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607492.687092:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbded1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a3d expref: 62 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687113:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4100) 00010000:00010000:2.0:1789607492.687124:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607492.687144:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687157:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687167:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687222:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687230:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687238:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687300:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687308:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687320:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687326:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607492.687331:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687338:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687347:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:2.0:1789607492.687349:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607492.687353:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687359:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbdedf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687368:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687374:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687379:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687384:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607492.687387:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687401:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687409:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x22aa716 (ffff8d78c6f8c400) 00010000:00010000:2.0:1789607492.687412:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607492.687415:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.687421:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbdee6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x22aa716 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.687500:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130049280:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 499us (705us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607492.687508:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:2.0:1789607492.696664:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.696769:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130049408 00000100:00100000:1.0:1789607492.696779:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130049408 00000100:00100000:1.0:1789607492.696841:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:1.0:1789607492.696851:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:11513:x1876539130049408:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607492.696917:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607492.696948:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdeed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.696986:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.696998:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.697009:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.697112:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdeed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 63 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.697139:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 62 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.697146:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:1.0:1789607492.697149:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607492.697152:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184a00, rc 0) 00000100:00100000:1.0:1789607492.697199:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:11513:x1876539130049408:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 349us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.697206:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:0.0:1789607492.706460:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.706552:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130049664 00000100:00100000:1.0:1789607492.706563:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130049664 00000100:00100000:1.0:1789607492.706625:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:1.0:1789607492.706637:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:11513:x1876539130049664:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607492.706720:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.706738:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.706751:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607492.710393:0:12196:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1789607492.710732:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef93509d reply state 00000000a9686811 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.710754:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.710763:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:0.0:1789607492.710766:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789607492.710770:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607492.711297:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:11513:x1876539130049664:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 4658us (4842us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789607492.711306:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:0.0:1789607492.713854:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.714248:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130049792 00000100:00100000:3.0:1789607492.714268:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130049792 00000100:00100000:3.0:1789607492.714368:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:3.0:1789607492.714378:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:11513:x1876539130049792:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607492.714404:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607492.714425:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a4b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.714484:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 65 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.714508:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 65 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.714530:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:3.0:1789607492.714533:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607492.714536:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ec00, rc 0) 00000100:00100000:3.0:1789607492.714595:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:11513:x1876539130049792:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 218us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.714602:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:2.0:1789607492.722520:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.722594:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130049920 00000100:00100000:3.0:1789607492.722603:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130049920 00000100:00100000:3.0:1789607492.722711:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1789607492.722721:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130049920:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789607492.725185:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2395:x1876539130049920:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 2457us (2666us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789607492.725196:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:0.0:1789607492.730434:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.730530:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130050176 00000100:00100000:3.0:1789607492.730539:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130050176 00000100:00100000:3.0:1789607492.730627:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:3.0:1789607492.730647:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:11513:x1876539130050176:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607492.731076:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:11513:x1876539130050176:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 437us (649us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789607492.731086:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1789607492.739438:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.740104:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130050432 00000100:00100000:3.0:1789607492.740130:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130050432 00000100:00100000:3.0:1789607492.740192:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:3.0:1789607492.740203:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:11513:x1876539130050432:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607492.740318:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:11513:x1876539130050432:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 117us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.740326:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:2.0:1789607492.751112:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.751201:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130050560 00000100:00100000:0.0:1789607492.751211:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130050560 00000100:00100000:0.0:1789607492.751275:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:0.0:1789607492.751285:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:11513:x1876539130050560:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607492.751306:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607492.751325:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdf09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a52 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.751385:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.751416:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.751428:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607492.751464:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607492.751484:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.751510:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbdf09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a52 expref: 68 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.751527:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a52 expref: 67 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.751534:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:0.0:1789607492.751537:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789607492.751541:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9e00, rc 0) 00000100:00100000:0.0:1789607492.751604:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:11513:x1876539130050560:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 322us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.751612:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:0.0:1789607492.758110:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.758254:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130050688 00000100:00100000:2.0:1789607492.758263:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130050688 00000100:00100000:2.0:1789607492.758322:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:2.0:1789607492.758333:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2394:x1876539130050688:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607492.758349:0:9649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607492.758368:0:9649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a59 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607492.758394:0:9649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3e45, blocks: 0x1 00010000:00010000:2.0:1789607492.758412:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1789607492.758430:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607492.758439:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 10 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.758459:0:9649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 10 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.758472:0:9649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580400, rc 0) 00000100:00100000:2.0:1789607492.758527:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2394:x1876539130050688:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 197us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.758535:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:2.0:1789607492.761534:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.761612:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130050944 00000100:00100000:3.0:1789607492.761626:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130050944 00000100:00100000:3.0:1789607492.761690:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:3.0:1789607492.761700:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:11513:x1876539130050944:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607492.762300:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:11513:x1876539130050944:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 600us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.762308:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:0.0:1789607492.764858:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.765048:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051072 00000100:00100000:2.0:1789607492.765065:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051072 00000100:00100000:2.0:1789607492.765112:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1789607492.765121:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:11513:x1876539130051072:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607492.765139:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607492.765155:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a60 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.765205:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.765215:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607492.765219:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607492.765224:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.765259:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.765272:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.765286:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f6324a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8112:1876539150050432:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607492.765364:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607492.767806:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f6324a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8112:1876539150050432:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607492.767840:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.767859:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581000, rc 0) 00000100:00100000:2.0:1789607492.768108:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:11513:x1876539130051072:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 2986us (3256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.768116:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:1.0:1789607492.768829:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.768935:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051200 00000100:00100000:3.0:1789607492.768944:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051200 00010000:00010000:3.0:1789607492.768980:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.769019:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:3.0:1789607492.769028:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:2396:x1876539130051200:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607492.769041:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.769071:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.769084:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.769119:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbdf17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a59 expref: 11 pid: 9649 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.769134:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607492.769139:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607492.769147:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.769157:0:6455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.769193:0:6455:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.769209:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa62a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6455:1876539150050560:192.168.203.25@tcp:105: 00000100:00100000:3.0:1789607492.769282:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607492.776951:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa62a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6455:1876539150050560:192.168.203.25@tcp:105: 00010000:00010000:3.0:1789607492.776979:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607492.777036:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2396:x1876539130051200:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 8008us (8209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.777046:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:0.0:1789607492.781045:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.781207:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051328 00000100:00100000:2.0:1789607492.781218:0:8118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051328 00002000:00100000:2.0:1789607492.781264:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d78fd4e9c00 x1876539130051328/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:48/0 lens 504/0 e 0 to 0 dl 1789607503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607492.781276:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fd4e9c00 with x1876539130051328 ext(0->12) 00002000:00010000:2.0:1789607492.781282:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fd4e9c00 00000100:00100000:2.0:1789607492.781315:0:8118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1789607492.781339:0:8118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2395:x1876539130051328:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789607492.781773:0:8118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+12:2395:x1876539130051328:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 434us (736us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789607492.781781:0:8118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00002000:00100000:2.0:1789607492.781788:0:8118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d78fd4e9c00 x1876539130051328/t4294967309(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:48/0 lens 504/448 e 0 to 0 dl 1789607503 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607492.781797:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fd4e9c00 with x1876539130051328 ext(0->12) 00002000:00010000:2.0:1789607492.781801:0:8118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fd4e9c00 00000100:00100000:1.0:1789607492.791177:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.792535:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051456 00000100:00100000:2.0:1789607492.792550:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051456 00000100:00100000:2.0:1789607492.792628:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:2.0:1789607492.792639:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:11513:x1876539130051456:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1789607492.841435:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789607492.841467:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1789607492.841506:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789607492.841549:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78fd5d2c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789607492.841554:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78c3f65700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78fd5d2480 00000020:00080000:2.0:1789607492.841557:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78c3f65b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d78f77d5c00 00000020:00080000:2.0:1789607492.841570:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1789607492.841576:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789607492.841589:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789607492.841604:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78f050ad80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789607492.841607:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78fa637a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78f050a0c0 00000020:00080000:2.0:1789607492.841609:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78fa637400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7900a4fc00 00000020:00080000:2.0:1789607492.841647:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789607492.841808:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1789607492.841983:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842004:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842012:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842018:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607492.842022:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842030:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842045:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d78c6f8c100) 00010000:00010000:1.0:1789607492.842048:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607492.842064:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842070:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184000/0xa26202d240fbdc3f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842098:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842104:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842109:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842113:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607492.842122:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842129:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842138:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:1.0:1789607492.842140:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607492.842143:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842149:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdcd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842171:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842178:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842185:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842190:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607492.842193:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842199:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842207:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607492.842209:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607492.842221:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842227:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbdd57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842239:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842245:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842251:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842256:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607492.842259:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842265:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842273:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78e28a4000) 00010000:00010000:1.0:1789607492.842275:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607492.842278:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842283:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdd7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842296:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842312:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842318:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842323:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607492.842327:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842333:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842342:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:1.0:1789607492.842345:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607492.842348:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842355:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbde3e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842368:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842374:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842379:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842383:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607492.842392:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842399:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842407:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:1.0:1789607492.842409:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607492.842413:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.842419:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184200/0xa26202d240fbdefb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.844108:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11513:x1876539130051456:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 51461us (52931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.844120:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:2.0:1789607492.847125:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150050688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789607492.847205:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607492.847277:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150050688 00000100:00100000:2.0:1789607492.847285:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150050688 00000100:00100000:2.0:1789607492.847338:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789607492.847347:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150050688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789607492.847374:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1789607492.847399:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.847420:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.847430:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789607492.847435:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607492.847440:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.847474:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.847488:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 11 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.847517:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f6327100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150050816:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607492.847572:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d2780 going to sleep for 11 seconds 00000100:00080000:2.0:1789607492.847588:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607492.849322:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607492.849340:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150050944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789607492.849400:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607492.849442:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150050944 00000100:00100000:1.0:1789607492.849449:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150050944 00000100:00100000:1.0:1789607492.849492:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789607492.849501:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790030e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150050944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789607492.849523:0:13082:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1789607492.849556:0:13082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aab3e44, atime: 0x6aab3e44, ctime: 0x6aab3e44, blocks: 0x1 00010000:00010000:1.0:1789607492.849564:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.849578:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1789607492.849582:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607492.849588:0:13082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.849631:0:13082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.849641:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.849649:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.849668:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607492.850294:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790030e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150050944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 793us (892us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789607492.850303:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1789607492.850330:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607492.850337:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.850346:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607492.850350:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.850360:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.850376:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.850390:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008467eb2c/0xa26202d240fbdf2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.850411:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607492.850412:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607492.850414:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789607492.850443:0:3468:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d790118ed80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789607492.850449:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150050944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789607492.850643:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607492.850655:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150051072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607492.850690:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607492.850731:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150051072 00000100:00100000:0.0:1789607492.850736:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150051072 00000100:00100000:0.0:1789607492.850766:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789607492.850773:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150051072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607492.850805:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607492.850843:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150051072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.850849:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789607492.850917:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150051072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607492.855940:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.856218:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051584 00000100:00100000:2.0:1789607492.856228:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051584 00000100:00100000:2.0:1789607492.856285:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1789607492.856295:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+12:2396:x1876539130051584:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789607492.863363:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607492.863399:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051712 00000100:00100000:2.0:1789607492.863407:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051712 00010000:00010000:2.0:1789607492.863444:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 13 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.863481:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:2.0:1789607492.863491:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f29450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2396:x1876539130051712:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607492.863506:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607492.863511:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 13 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.863525:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 13 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.863550:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607492.863555:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607492.863573:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.863584:0:7268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.863605:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607492.863654:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f29450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2396:x1876539130051712:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 164us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.863661:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 74 00010000:00010000:3.0:1789607492.863782:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a0a637/0xa26202d240fbdce7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689bf expref: 12 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.863813:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f6327100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150050816:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607492.863832:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.863842:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.863850:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.863916:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.863925:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.863938:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607492.864205:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607492.864213:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.864221:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607492.864226:0:7735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.864235:0:7735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.864249:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.864256:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4a8956a/0xa26202d240fbdf25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.864285:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607492.864287:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607492.864288:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607492.864809:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150050688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17460us (17600us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789607492.864819:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1789607492.872313:0:3468:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78fa62a680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789607492.872346:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150050688:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789607492.903219:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789607492.903463:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789607492.903474:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1789607492.903631:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130051584:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 47332us (47696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.903643:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1789607492.906304:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.906414:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130051968 00000100:00100000:1.0:1789607492.906424:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130051968 00000100:00100000:1.0:1789607492.906517:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:1.0:1789607492.906528:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11513:x1876539130051968:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607492.906583:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607492.906613:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a52 expref: 15 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.906631:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:1.0:1789607492.906636:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607492.906664:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.906677:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.906700:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607492.907560:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e7127ae reply state 00000000c37d36d6 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.907580:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.907588:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:1.0:1789607492.907591:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607492.907594:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607492.907832:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:11513:x1876539130051968:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 1303us (1534us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789607492.907840:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:0.0:1789607492.915789:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.916329:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130052096 00000100:00100000:1.0:1789607492.916340:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130052096 00000100:00100000:0.0:1789607492.916450:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:0.0:1789607492.916461:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130052096:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789607492.916687:0:13082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789607492.916691:0:13082:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789607493 00002000:00010000:0.0:1789607492.916694:0:13082:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789607492 00002000:00010000:0.0:1789607492.916696:0:13082:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789607493 -> 1789607493 00002000:00010000:0.0:1789607492.916698:0:13082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789607492.916778:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130052096:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 317us (997us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789607492.916786:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1789607492.918961:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.919255:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130052352 00000100:00100000:0.0:1789607492.919264:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130052352 00000100:00100000:0.0:1789607492.919317:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:0.0:1789607492.919325:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:11513:x1876539130052352:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789607492.919385:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.919411:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 16 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.919421:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.919451:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 16 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.919464:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 16 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.919478:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150051200:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607492.919606:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607492.922439:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.923189:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150051200:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.923218:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.923340:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130052480 00000100:00100000:2.0:1789607492.923347:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130052480 00010000:00010000:2.0:1789607492.923386:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 17 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607492.923472:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:2.0:1789607492.923482:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:2395:x1876539130052480:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607492.923498:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607492.923505:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 17 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.923518:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 17 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.923540:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdef4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a44 expref: 17 pid: 6469 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.923557:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:2.0:1789607492.923562:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.923580:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.923588:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.923617:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607492.923676:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:2395:x1876539130052480:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 195us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607492.923683:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00010000:00010000:0.0:1789607492.923733:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923741:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923768:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923775:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923788:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923794:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607492.923799:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923806:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923815:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:0.0:1789607492.923819:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789607492.923822:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.923829:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbdf3a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.923916:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11513:x1876539130052352:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 4576us (4947us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789607492.923925:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:0.0:1789607492.926368:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607492.926460:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130052608 00000100:00100000:1.0:1789607492.926470:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130052608 00000100:00100000:1.0:1789607492.926525:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607492.926535:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130052608:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789607492.926582:0:9649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.926603:0:9649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.926613:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607492.926631:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607492.926636:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.926672:0:9649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607492.926688:0:9649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 7 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607492.926702:0:9649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9649:1876539150051328:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607492.926784:0:9649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607492.930378:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.930447:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130052736 00000100:00100000:3.0:1789607492.930455:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130052736 00010000:00010000:3.0:1789607492.930497:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 8 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.930539:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:3.0:1789607492.930549:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130052736:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607492.930563:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.930587:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 8 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.930599:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 8 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.930623:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607492.930628:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607492.930634:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.930644:0:7268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.930665:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607492.930720:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130052736:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 173us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.930728:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00010000:00010000:0.0:1789607492.932131:0:9649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbdf1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a60 expref: 7 pid: 8112 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.932152:0:9649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9649:1876539150051328:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.932226:0:9649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932257:0:9649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932263:0:9649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932290:0:9649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932298:0:9649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932306:0:9649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932313:0:9649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607492.932317:0:9649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932325:0:9649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932342:0:9649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.932360:0:9649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbdf41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.932490:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130052608:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 5955us (6130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.932499:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1789607492.935278:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.935379:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130052992 00000100:00100000:0.0:1789607492.935389:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130052992 00000100:00100000:0.0:1789607492.935449:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 136 00000100:00100000:0.0:1789607492.935460:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11513:x1876539130052992:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789607492.935539:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935556:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935568:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935759:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935771:0:7709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 16 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935780:0:7709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935823:0:7709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 16 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.935837:0:7709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 16 pid: 6468 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.935851:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150051456:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607492.935978:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607492.942395:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.942473:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130053120 00000100:00100000:3.0:1789607492.942482:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130053120 00010000:00010000:3.0:1789607492.942520:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 17 pid: 6468 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.942561:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:3.0:1789607492.942570:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:2395:x1876539130053120:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607492.942584:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607492.942590:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 17 pid: 6468 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.942603:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 17 pid: 6468 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.942624:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:3.0:1789607492.942630:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.942639:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.942647:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.942666:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607492.942730:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:2395:x1876539130053120:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.942737:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00010000:00010000:0.0:1789607492.943191:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbdf02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a4b expref: 16 pid: 6468 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.943210:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150051456:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607492.943233:0:7709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.943242:0:7709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.943247:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607492.943434:0:7709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789607492.943584:0:7709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789607492.943634:0:7709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789607492.943712:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7709:1876539150051584:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789607492.943782:0:7709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607492.943816:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607492.944331:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150051584 00000100:00100000:1.0:1789607492.944338:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150051584 00000100:00100000:1.0:1789607492.944382:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789607492.944390:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7709:x1876539150051584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789607492.944485:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7709:x1876539150051584:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607492.944492:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789607492.944776:0:7709:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1789607492.944787:0:7709:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1789607492.944810:0:7709:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d78fa62a680 x1876539150050688/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789607508 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607492.944821:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7709:1876539150051584:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789607492.945263:0:7709:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789607492.945321:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa628700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7709:1876539150051712:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789607492.945354:0:7709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607492.945374:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607492.945893:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150051712 00000100:00100000:0.0:1789607492.945919:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150051712 00000100:00100000:0.0:1789607492.945954:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789607492.945961:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7709:x1876539150051712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789607492.946174:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7709:x1876539150051712:12345-0@lo:1000:mdt00_003.0 Request processed in 205us (811us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789607492.946182:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789607492.947305:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa628700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7709:1876539150051712:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789607492.947348:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947358:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947366:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947372:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.947376:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947383:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947398:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:3.0:1789607492.947402:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607492.947406:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947432:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbdf4f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947458:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947464:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947470:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947475:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.947478:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947484:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947493:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.947495:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607492.947502:0:7709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 19 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947514:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 19 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947522:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 19 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.947569:0:7709:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 19 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.947582:0:7709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150051840:192.168.203.25@tcp:105: 00000100:00100000:3.0:1789607492.947660:0:7709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f050ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607492.954848:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.954917:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130053248 00000100:00100000:0.0:1789607492.954927:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130053248 00000100:00100000:0.0:1789607492.954979:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:0.0:1789607492.954989:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11511:x1876539130053248:12345-192.168.203.25@tcp:49:lfs.0 00000100:00100000:3.0:1789607492.955068:0:7709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7709:1876539150051840:192.168.203.25@tcp:105: 00010000:00010000:3.0:1789607492.955093:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955104:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbde92 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.955129:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11511:x1876539130053248:12345-192.168.203.25@tcp:49:lfs.0 Request processed in 141us (291us total) trans 0 rc 0/0 00010000:00010000:3.0:1789607492.955132:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607492.955137:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00010000:00010000:3.0:1789607492.955145:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955156:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955166:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955172:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955178:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955201:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.955205:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955212:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955224:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.955226:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607492.955231:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955237:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955248:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955254:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955260:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955265:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.955268:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955273:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955294:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.955297:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789607492.955300:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.955306:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbdf48 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.955660:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:11513:x1876539130052992:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 20201us (20392us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789607492.955669:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 136 00000020:00080000:3.0:1789607492.955673:0:7709:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789607492.957706:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.957779:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130053504 00000100:00100000:3.0:1789607492.957795:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130053504 00000100:00100000:3.0:1789607492.957927:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:3.0:1789607492.957937:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:11511:x1876539130053504:12345-192.168.203.25@tcp:58:lfs.0 00000040:00080000:3.0:1789607492.958493:0:6469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789607492.958733:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:11511:x1876539130053504:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 794us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607492.958742:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 137 00000040:00080000:1.0:1789607492.960928:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607492.960937:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607492.960976:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789607492.960983:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607492.961098:0:13335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150051968:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607492.961172:0:13335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607492.965165:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.965291:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130053760 00000100:00100000:0.0:1789607492.965299:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130053760 00000100:00100000:0.0:1789607492.965357:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:0.0:1789607492.965367:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0072050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:11513:x1876539130053760:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789607492.966367:0:6472:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789607492.966487:0:6472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789607492.966538:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.966553:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.966564:0:6472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.966581:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.966587:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.966593:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607492.966618:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607492.966786:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607492.966795:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.966801:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607492.966805:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.966813:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.966825:0:6458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:2.0:1789607492.966828:0:6458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789607492.966833:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.966839:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbdf5d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607492.966857:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607492.966858:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607492.966909:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607492.966963:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0072050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:11513:x1876539130053760:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 1593us (1920us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789607492.966973:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000020:00080000:0.0:1789607492.966978:0:6472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607492.971240:0:13335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150051968:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607492.975501:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607492.975589:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130053888 00000100:00100000:0.0:1789607492.975599:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130053888 00000100:00100000:0.0:1789607492.975656:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:0.0:1789607492.975667:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:11514:x1876539130053888:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607492.975704:0:6468:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607492.975807:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:11514:x1876539130053888:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607492.975815:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:1.0:1789607492.981585:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.982138:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130054144 00000100:00100000:3.0:1789607492.982148:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130054144 00000100:00100000:3.0:1789607492.982304:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:3.0:1789607492.982316:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:11514:x1876539130054144:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607492.982348:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607492.982369:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a67 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.982467:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.982483:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.982495:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607492.982507:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789607492.982637:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a67 expref: 24 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.982656:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a67 expref: 23 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.982664:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.982667:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607492.982670:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f000, rc 0) 00000100:00100000:3.0:1789607492.982736:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:11514:x1876539130054144:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 422us (1160us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789607492.982743:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:1.0:1789607492.989514:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.989579:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130054400 00000100:00100000:3.0:1789607492.989589:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130054400 00000100:00100000:3.0:1789607492.989642:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:3.0:1789607492.989666:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:11514:x1876539130054400:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607492.989743:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.989761:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.989773:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990230:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990240:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990247:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990252:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607492.990257:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990265:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990277:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607492.990280:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789607492.990285:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607492.990291:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf79 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607492.990445:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:11514:x1876539130054400:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 781us (939us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789607492.990454:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 140 00000040:00080000:1.0:1789607492.990613:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607492.990618:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607492.991253:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789607492.991263:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607492.993487:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607492.993560:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130054656 00000100:00100000:3.0:1789607492.993572:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130054656 00000100:00100000:3.0:1789607492.993622:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1789607492.993633:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:11514:x1876539130054656:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607492.993890:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:11514:x1876539130054656:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 259us (411us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789607492.993907:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1789607493.013454:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607493.013527:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130054784 00000100:00100000:3.0:1789607493.013537:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130054784 00000100:00100000:3.0:1789607493.013599:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:3.0:1789607493.013608:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:11516:x1876539130054784:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607493.013631:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607493.013648:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a6e expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.013721:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.013735:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.013746:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.013769:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.013776:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.013783:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789607493.014183:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789607493.014384:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.014398:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 26 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.014417:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.014450:0:6470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 26 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.014462:0:6470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 26 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607493.014476:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150052096:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607493.014551:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607493.020253:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607493.020314:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055040 00000100:00100000:3.0:1789607493.020322:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055040 00000100:00100000:3.0:1789607493.020375:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:3.0:1789607493.020384:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+27:6371:x1876539130055040:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789607493.020604:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:6371:x1876539130055040:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 220us (359us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789607493.020611:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:0.0:1789607493.021110:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150052096:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607493.021134:0:6470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607493.024972:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607493.025157:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055168 00000100:00100000:3.0:1789607493.025166:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055168 00010000:00010000:3.0:1789607493.025204:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 28 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607493.025238:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:3.0:1789607493.025246:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:2396:x1876539130055168:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607493.025262:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607493.025268:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 28 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.025298:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 28 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.025319:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbde84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a28 expref: 28 pid: 12196 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.025333:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607493.025339:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.025348:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.025356:0:7268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.025374:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607493.025430:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+27:2396:x1876539130055168:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 184us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607493.025437:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00010000:00010000:0.0:1789607493.025785:0:6470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.025795:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607493.025834:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789607493.025839:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607493.025858:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026070:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026092:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026099:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026106:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026112:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607493.026116:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026124:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026134:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:0.0:1789607493.026139:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607493.026143:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026148:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbdf87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026160:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026167:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026172:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026184:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ea00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607493.026187:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026192:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026200:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d78d9b83300) 00010000:00010000:0.0:1789607493.026202:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607493.026205:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026211:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdf8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026247:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdf80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a6e expref: 27 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026261:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a6e expref: 26 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.026268:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607493.026271:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607493.026273:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9200, rc 0) 00000100:00100000:0.0:1789607493.026319:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:11516:x1876539130054784:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 12712us (12873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607493.026327:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:1.0:1789607493.346568:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150052224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607493.346639:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607493.346749:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052224 00000100:00100000:2.0:1789607493.346758:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052224 00000100:00100000:2.0:1789607493.346807:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789607493.346816:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150052224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607493.346856:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607493.347892:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150052224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1074us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607493.347911:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789607493.348402:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150052224:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789607493.769011:0:13855:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607493.769022:0:13855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607493.770205:0:13855:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789607493.770214:0:13855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789607493.867197:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607493.981318:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607493.981392:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055424 00000100:00100000:3.0:1789607493.981407:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055424 00000100:00100000:3.0:1789607493.981471:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:3.0:1789607493.981482:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:11539:x1876539130055424:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607493.981507:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607493.981527:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbdf9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a75 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.981658:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbdfa3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.981672:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbdfa3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.981683:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbdfa3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607493.981694:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789607493.981815:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbdf9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a75 expref: 29 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.981834:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbdfa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a75 expref: 28 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607493.981842:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607493.981845:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789607493.981848:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e600, rc 0) 00000100:00100000:3.0:1789607493.981950:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:11539:x1876539130055424:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 470us (640us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789607493.981957:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:2.0:1789607493.991612:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607493.992225:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055552 00000100:00100000:0.0:1789607493.992951:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055552 00000100:00100000:0.0:1789607493.994194:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:0.0:1789607493.994212:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:11539:x1876539130055552:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607493.994296:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994313:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994326:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994351:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994357:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994364:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994371:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607493.994375:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994382:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994393:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607493.994396:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607493.994401:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607493.994421:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbdfb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607493.994506:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:11539:x1876539130055552:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 301us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607493.994513:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:2.0:1789607494.088019:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607494.088300:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055680 00000100:00100000:1.0:1789607494.088310:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055680 00000100:00100000:1.0:1789607494.088390:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:1.0:1789607494.088401:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130055680:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:1.0:1789607494.088418:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607494.088438:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f6b694/0xa26202d240fbdfb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a7c expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607494.088465:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aab3e45, atime: 0x6aab3e44, ctime: 0x6aab3e45, blocks: 0xb 00010000:00010000:1.0:1789607494.088487:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1789607494.088492:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607494.088501:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f6b694/0xa26202d240fbdfb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a7c expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607494.088541:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7f6b694/0xa26202d240fbdfb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a7c expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607494.088555:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607494.088623:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130055680:12345-192.168.203.25@tcp:101:cat.0 Request processed in 223us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607494.088630:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00080000:2.0:1789607494.088710:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607494.100259:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607494.100364:0:8117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055808 00000100:00100000:2.0:1789607494.100374:0:8117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055808 00002000:00100000:2.0:1789607494.100430:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d78fcd5ca80 x1876539130055808/t0(0) o3->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:50/0 lens 488/0 e 0 to 0 dl 1789607505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607494.100443:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fcd5ca80 with x1876539130055808 ext(0->4095) 00002000:00010000:2.0:1789607494.100448:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fcd5ca80 00000100:00100000:2.0:1789607494.100483:0:8117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:2.0:1789607494.100493:0:8117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130055808:12345-192.168.203.25@tcp:3:cat.0 00000100:00100000:2.0:1789607494.100727:0:8117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130055808:12345-192.168.203.25@tcp:3:cat.0 Request processed in 235us (478us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789607494.100734:0:8117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00002000:00100000:2.0:1789607494.100741:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d78fcd5ca80 x1876539130055808/t0(0) o3->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:50/0 lens 488/4536 e 0 to 0 dl 1789607505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607494.100749:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fcd5ca80 with x1876539130055808 ext(0->4095) 00002000:00010000:2.0:1789607494.100752:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fcd5ca80 00010000:00010000:0.0:1789607494.883572:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607495.177079:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607495.177159:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607495.177192:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607495.177270:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056320 00000100:00100000:3.0:1789607495.177281:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056320 00000100:00100000:3.0:1789607495.177349:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:3.0:1789607495.177360:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130056320:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607495.177430:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130056320:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 70us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607495.177448:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00080000:0.0:1789607495.177500:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607495.177712:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607495.177783:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607495.178101:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130055936 00000100:00100000:0.0:1789607495.178107:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130055936 00000100:00100000:0.0:1789607495.178152:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 381 00000100:00100000:0.0:1789607495.178161:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130055936:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607495.178201:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130055936:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 41us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.178208:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 381 00000100:00100000:1.0:1789607495.178420:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056064 00000100:00100000:1.0:1789607495.178425:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056064 00000100:00100000:1.0:1789607495.178472:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056576 00000100:00100000:1.0:1789607495.178476:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056576 00000100:00100000:1.0:1789607495.178500:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 305 00000100:00100000:1.0:1789607495.178508:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:2394:x1876539130056064:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607495.178543:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:2394:x1876539130056064:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607495.178549:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 305 00000100:00100000:1.0:1789607495.178564:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 306 00000100:00100000:1.0:1789607495.178571:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130056576:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607495.178597:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130056576:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607495.178603:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 306 00000100:00080000:0.0:1789607495.179001:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607495.179164:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607495.179228:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607495.179329:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056192 00000100:00100000:0.0:1789607495.179336:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056192 00000100:00100000:0.0:1789607495.179374:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056704 00000100:00100000:0.0:1789607495.179378:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056704 00000100:00100000:0.0:1789607495.179398:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 307 00000100:00100000:0.0:1789607495.179406:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130056192:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607495.179443:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130056192:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 37us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.179449:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 307 00000100:00100000:0.0:1789607495.179463:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 308 00000100:00100000:0.0:1789607495.179482:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130056704:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607495.179506:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2394:x1876539130056704:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.179511:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 308 00000100:00080000:2.0:1789607495.179556:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607495.179583:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056448 00000100:00100000:1.0:1789607495.179587:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056448 00000100:00100000:1.0:1789607495.179625:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:1.0:1789607495.179635:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130056448:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607495.179663:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130056448:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607495.179668:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:0.0:1789607495.401080:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150052608:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401148:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607495.401194:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150053120:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401218:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607495.401234:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150053632:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401251:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607495.401272:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789607495.401277:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150052736:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401295:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607495.401314:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150053248:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401334:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607495.401352:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150053760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401370:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607495.401402:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052608 00000100:00100000:0.0:1789607495.401409:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052608 00000100:00100000:0.0:1789607495.401448:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789607495.401455:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150052608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401516:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150052608:12345-0@lo:400:kworker.0 Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.401523:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789607495.401547:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053120 00000100:00100000:0.0:1789607495.401562:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053120 00000100:00100000:0.0:1789607495.401606:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053632 00000100:00100000:0.0:1789607495.401609:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053632 00000100:00100000:0.0:1789607495.401624:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052736 00000100:00100000:0.0:1789607495.401626:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052736 00000100:00100000:0.0:1789607495.401637:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789607495.401643:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150053120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401672:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150053120:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.401678:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789607495.401689:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789607495.401694:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150053632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401717:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150053632:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.401722:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789607495.401732:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789607495.401736:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f7571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150052736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401757:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f7571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150052736:12345-0@lo:400:kworker.0 Request processed in 21us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.401763:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789607495.401777:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053248 00000100:00100000:0.0:1789607495.401780:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053248 00000100:00100000:0.0:1789607495.401798:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053760 00000100:00100000:0.0:1789607495.401801:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053760 00000100:00100000:0.0:1789607495.401820:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789607495.401826:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150053248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401854:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150053248:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.401900:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789607495.401913:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789607495.401923:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150053760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.401953:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150053760:12345-0@lo:400:kworker.0 Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.401958:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789607495.402002:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150052736:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.402012:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150053248:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.402021:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150053760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607495.402029:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150052608:0@lo:400:kworker.0 00010000:00080000:0.0:1789607495.402039:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd4e9880 x1876539150053120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607495.402048:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150053120:0@lo:400:kworker.0 00010000:00080000:0.0:1789607495.402056:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a56300 x1876539150053632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607495.402062:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150053632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402684:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150052352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402725:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.402755:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150052864:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402775:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.402792:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150053376:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402809:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.402823:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150053888:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402839:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.402857:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789607495.402894:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150052480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402926:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.402943:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150052992:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402960:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.402974:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150053504:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.402989:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607495.403015:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607495.403019:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607495.403022:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789607495.403226:0:9400:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400360362549ns, next at 401360360350ns, rc = 0 00000100:00100000:3.0:1789607495.403263:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150054144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607495.403293:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.403343:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052352 00000100:00100000:2.0:1789607495.403350:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052352 00000100:00100000:2.0:1789607495.403392:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789607495.403399:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150052352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.403439:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150052352:12345-0@lo:400:kworker.0 Request processed in 41us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607495.403445:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789607495.403567:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052864 00000100:00100000:2.0:1789607495.403571:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052864 00000100:00100000:2.0:1789607495.403750:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789607495.403758:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150052864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.403792:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150052864:12345-0@lo:400:kworker.0 Request processed in 35us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607495.403797:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789607495.403922:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052480 00000100:00100000:1.0:1789607495.403926:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052480 00000100:00100000:1.0:1789607495.403948:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150052992 00000100:00100000:1.0:1789607495.403950:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150052992 00000100:00100000:1.0:1789607495.403968:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053504 00000100:00100000:1.0:1789607495.403970:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053504 00000100:00100000:1.0:1789607495.403982:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789607495.403989:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150052480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607495.404024:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150052480:12345-0@lo:400:kworker.0 Request processed in 36us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607495.404030:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789607495.404182:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789607495.404189:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150052992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607495.404221:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150052992:12345-0@lo:400:kworker.0 Request processed in 33us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607495.404227:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789607495.404239:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789607495.404245:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150053504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607495.404273:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150053504:12345-0@lo:400:kworker.0 Request processed in 29us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607495.404278:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789607495.405267:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053376 00000100:00100000:2.0:1789607495.405277:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053376 00000100:00100000:2.0:1789607495.405320:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150053888 00000100:00100000:2.0:1789607495.405325:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150053888 00000100:00100000:2.0:1789607495.405358:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789607495.405367:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150053376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405431:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150053376:12345-0@lo:400:kworker.0 Request processed in 66us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607495.405438:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789607495.405452:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789607495.405459:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150053888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405624:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150053888:12345-0@lo:400:kworker.0 Request processed in 165us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607495.405631:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789607495.405655:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150054016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607495.405688:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607495.405751:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150052480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405763:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150052992:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405774:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150053504:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405783:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150052352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405793:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150052864:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405803:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150053376:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405811:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150053888:0@lo:400:kworker.0 00000100:00100000:2.0:1789607495.405845:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054144 00000100:00100000:2.0:1789607495.405850:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054144 00000100:00100000:0.0:1789607495.406129:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054016 00000100:00100000:0.0:1789607495.406134:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054016 00000100:00100000:0.0:1789607495.406169:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789607495.406176:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150054016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607495.406202:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607495.406241:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150054016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607495.406254:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789607495.406345:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789607495.406353:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150054144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607495.406363:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607495.406437:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150054144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607495.406444:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1789607495.406458:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607495.406463:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607495.406465:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607495.406497:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150054016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607495.408068:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150054144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789607495.906190:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789607496.480504:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789607496.480521:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:3.0:1789607496.933219:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607497.122207:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607497.122216:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607497.122250:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789607497.122257:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789607497.378582:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607497.442206:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607497.442222:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607497.442230:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150054400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607497.442238:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150054272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607497.446110:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607497.451188:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054400 00000100:00100000:3.0:1789607497.451205:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054400 00000100:00100000:3.0:1789607497.451296:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789607497.451310:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150054400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607497.451346:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607497.451436:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150054400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (5331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607497.451443:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789607497.451505:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150054400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607497.451886:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607497.452197:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054272 00000100:00100000:0.0:1789607497.452212:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054272 00000100:00100000:0.0:1789607497.452249:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789607497.452256:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150054272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607497.452271:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607497.452328:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150054272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607497.452335:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789607497.452546:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789607497.452553:0:3470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789607497.452573:0:3470:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d790118ed80, transno 4294967305 00000100:00100000:1.0:1789607497.452598:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150054272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607497.453134:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607497.955512:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150054528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607497.955606:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607497.955902:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054528 00000100:00100000:3.0:1789607497.955911:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054528 00000100:00100000:3.0:1789607497.955977:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789607497.955986:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150054528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607497.956029:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607497.956071:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150054528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607497.956087:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789607497.956395:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150054528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789607497.956689:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789607498.040751:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789607498.040766:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789607498.049631:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:2.0:1789607498.049657:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:2.0:1789607498.049678:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:2.0:1789607498.049692:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789607498.049710:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78fd5d2480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789607498.049714:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78fa637100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78f643e300 00000020:00080000:2.0:1789607498.049718:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78fa637c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d78f0622000 00000020:00080000:1.0:1789607498.049825:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789607498.050048:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789607498.050069:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150054656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607498.050138:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607498.050313:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607498.050323:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607498.050331:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607498.050337:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607498.050342:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607498.050349:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607498.050366:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:0.0:1789607498.050380:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607498.050385:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607498.050392:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdf33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607498.050461:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054656 00000100:00100000:2.0:1789607498.050471:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054656 00000100:00100000:2.0:1789607498.050540:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607498.050557:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150054656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789607498.050746:0:8114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789607498.050750:0:8114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789607493 -> 1789607493 00002000:00010000:2.0:1789607498.050752:0:8114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1789607492 -> 1789607492 00002000:00010000:2.0:1789607498.050754:0:8114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789607493 -> 1789607493 00002000:00010000:2.0:1789607498.050756:0:8114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789607498.050801:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150054656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (663us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789607498.050809:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789607498.051302:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607498.051819:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789607498.051827:0:3470:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78fa62a680, transno 4294967310 00000004:00080000:1.0:1789607498.051850:0:3470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789607498.051900:0:3470:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d78fd116a00 x1876539150054656/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789607514 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789607498.051913:0:3470:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78fd116a00/2, rc 0, transno 4294967313 00000100:00100000:1.0:1789607498.051918:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150054656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607498.467069:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150054784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607498.467142:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607498.467287:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054784 00000100:00100000:3.0:1789607498.467297:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054784 00000100:00100000:3.0:1789607498.467347:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789607498.467357:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150054784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607498.467397:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607498.467460:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150054784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607498.467467:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789607498.467573:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150054784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607498.763400:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607498.763519:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056832 00000100:00100000:1.0:1789607498.763529:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056832 00000100:00100000:1.0:1789607498.763605:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00080000:0.0:1789607498.763612:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607498.763618:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11192:x1876539130056832:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789607498.763734:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11192:x1876539130056832:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607498.763742:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:1.0:1789607498.774357:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607498.774771:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130056960 00000100:00100000:3.0:1789607498.774781:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130056960 00000100:00100000:3.0:1789607498.774897:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 145 00000100:00100000:3.0:1789607498.774909:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:11192:x1876539130056960:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1789607498.775035:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607498.775593:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:11192:x1876539130056960:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 684us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607498.775609:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 145 00000100:00100000:3.0:1789607498.802025:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607498.802351:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057216 00000100:00100000:1.0:1789607498.802362:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057216 00000100:00100000:1.0:1789607498.802423:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1789607498.802433:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:11192:x1876539130057216:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789607498.802703:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:11192:x1876539130057216:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 271us (695us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789607498.802710:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00010000:00010000:2.0:1789607498.983359:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607500.002046:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607500.293394:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293565:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293592:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293634:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293658:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293677:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293723:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607500.293752:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057856 00000100:00100000:3.0:1789607500.293761:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057856 00000100:00100000:1.0:1789607500.293903:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057728 00000100:00100000:1.0:1789607500.293910:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057728 00000100:00100000:1.0:1789607500.293954:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:1.0:1789607500.293964:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130057728:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607500.294050:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130057728:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 87us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607500.294052:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057344 00000100:00100000:0.0:1789607500.294059:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057344 00000100:00100000:1.0:1789607500.294060:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00080000:1.0:1789607500.294112:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607500.294119:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607500.294125:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 383 00000100:00100000:2.0:1789607500.294127:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057600 00000100:00100000:0.0:1789607500.294139:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130057344:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607500.294155:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130058112 00000100:00100000:1.0:1789607500.294161:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130058112 00000100:00100000:0.0:1789607500.294171:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2395:x1876539130057344:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 38us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607500.294178:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 383 00000100:00100000:1.0:1789607500.294196:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057472 00000100:00100000:1.0:1789607500.294201:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057472 00000100:00100000:0.0:1789607500.294223:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130057984 00000100:00100000:1.0:1789607500.294228:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 315 00000100:00100000:0.0:1789607500.294230:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057984 00000100:00100000:1.0:1789607500.294238:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130058112:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607500.294247:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130057600 00000100:00100000:0.0:1789607500.294262:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 316 00000100:00100000:0.0:1789607500.294275:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:2395:x1876539130057472:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607500.294291:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130058112:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 53us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.294303:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 315 00000100:00100000:1.0:1789607500.294334:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 317 00000100:00100000:1.0:1789607500.294343:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130057984:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607500.294368:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2395:x1876539130057984:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607500.294430:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 318 00000100:00100000:2.0:1789607500.294446:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130057600:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607500.294471:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:2395:x1876539130057472:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 196us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607500.294482:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 316 00000100:00100000:2.0:1789607500.294518:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c416df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2395:x1876539130057600:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 75us (951us total) trans 0 rc 0/0 00000100:00080000:0.0:1789607500.294521:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607500.294529:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607500.294535:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 318 00000100:00100000:1.0:1789607500.295073:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 317 00000100:00100000:3.0:1789607500.295253:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:3.0:1789607500.295265:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130057856:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607500.295385:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130057856:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 124us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607500.295393:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:3.0:1789607500.514532:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150054912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607500.514597:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.514672:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150054912 00000100:00100000:3.0:1789607500.514679:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150054912 00000100:00100000:3.0:1789607500.514733:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789607500.514742:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150054912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607500.514776:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607500.514819:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150054912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607500.514826:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789607500.514855:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607500.514911:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150054912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607500.515019:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607500.515028:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150055040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607500.515060:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607500.515094:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055040 00000100:00100000:1.0:1789607500.515098:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055040 00000100:00100000:1.0:1789607500.515129:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789607500.515137:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d79003fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150055040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607500.515147:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607500.515180:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d79003fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150055040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.515187:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789607500.515365:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607500.515387:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150055040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607500.516486:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150055168:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.516535:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.516574:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150055680:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.516599:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.516619:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150056192:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.516661:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.516682:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789607500.516687:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150055296:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.516711:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.516731:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150055808:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.516751:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.516767:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150056320:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.516784:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607500.516807:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055680 00000100:00100000:3.0:1789607500.516813:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055680 00000100:00100000:3.0:1789607500.516878:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789607500.516887:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150055680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517027:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056192 00000100:00100000:1.0:1789607500.517032:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056192 00000100:00100000:1.0:1789607500.517069:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789607500.517076:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150056192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517130:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150056192:12345-0@lo:400:kworker.0 Request processed in 54us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517138:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1789607500.517160:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607500.517169:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150055424:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517198:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607500.517219:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150055936:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517238:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607500.517254:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150056448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517273:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607500.517292:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789607500.517298:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150055552:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517318:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607500.517330:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150056064:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517349:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607500.517376:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055424 00000100:00100000:1.0:1789607500.517380:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055424 00000100:00100000:1.0:1789607500.517400:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789607500.517406:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517440:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150055424:12345-0@lo:400:kworker.0 Request processed in 34us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517446:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789607500.517462:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055296 00000100:00100000:1.0:1789607500.517466:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055296 00000100:00100000:1.0:1789607500.517480:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055808 00000100:00100000:1.0:1789607500.517482:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055808 00000100:00100000:1.0:1789607500.517509:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056320 00000100:00100000:1.0:1789607500.517513:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056320 00000100:00100000:1.0:1789607500.517524:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055936 00000100:00100000:1.0:1789607500.517526:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055936 00000100:00100000:1.0:1789607500.517537:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056448 00000100:00100000:1.0:1789607500.517539:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056448 00000100:00100000:1.0:1789607500.517550:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055552 00000100:00100000:1.0:1789607500.517552:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055552 00000100:00100000:1.0:1789607500.517562:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789607500.517567:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517599:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150055296:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517605:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789607500.517616:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789607500.517621:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150055808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517648:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150055808:12345-0@lo:400:kworker.0 Request processed in 27us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517654:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789607500.517665:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789607500.517670:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150056320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517693:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150056320:12345-0@lo:400:kworker.0 Request processed in 23us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517698:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789607500.517708:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789607500.517713:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150055936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517739:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150055936:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517753:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789607500.517764:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789607500.517769:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150056448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517794:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150056448:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517800:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789607500.517810:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789607500.517816:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150055552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517853:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150055552:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517884:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789607500.517906:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056064 00000100:00100000:1.0:1789607500.517921:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056064 00000100:00100000:1.0:1789607500.517948:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789607500.517954:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150056064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.517985:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150056064:12345-0@lo:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607500.517990:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789607500.518008:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607500.518010:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607500.518012:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607500.518038:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150055296:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.518050:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150055808:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.518058:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150056320:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.518080:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150056192:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.518117:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150055552:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.518126:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150056064:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.518134:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150055424:0@lo:400:kworker.0 00010000:00080000:1.0:1789607500.518144:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55880 x1876539150055936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607500.518154:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150055936:0@lo:400:kworker.0 00010000:00080000:1.0:1789607500.518163:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcb7dc00 x1876539150056448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607500.518170:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150056448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607500.518401:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150055680:12345-0@lo:400:kworker.0 Request processed in 1514us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607500.518409:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789607500.519670:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150055168 00000100:00100000:0.0:1789607500.519681:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150055168 00000100:00100000:0.0:1789607500.519724:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789607500.519744:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150055168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607500.519810:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150055168:12345-0@lo:400:kworker.0 Request processed in 69us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607500.519817:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789607500.523001:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150055168:0@lo:400:kworker.0 00000100:00100000:1.0:1789607500.523025:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790118ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150055680:0@lo:400:kworker.0 00010000:00010000:0.0:1789607501.027908:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607501.060591:0:14054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:11:40 (1789607500) 00010000:00010000:2.0:1789607502.052986:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607502.445748:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607502.445913:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130058368 00000100:00100000:1.0:1789607502.445924:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130058368 00000100:00100000:1.0:1789607502.446007:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:1.0:1789607502.446019:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:12257:x1876539130058368:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607502.446039:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607502.446059:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdfbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a83 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446149:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446164:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446174:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446186:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446192:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446198:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446420:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdfd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446430:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446437:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607502.446447:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789607502.446553:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446560:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446573:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446579:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607502.446584:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446592:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446605:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78c73e1000) 00010000:00010000:1.0:1789607502.446609:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607502.446613:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446620:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbdfc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446634:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446639:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446644:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446649:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607502.446652:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446667:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446676:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d78e28a4200) 00010000:00010000:1.0:1789607502.446678:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607502.446681:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.446687:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbdfcd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789607502.447271:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789607502.448239:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbdfbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a83 expref: 18 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.448260:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a83 expref: 17 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607502.448269:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:1.0:1789607502.448271:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607502.448274:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185400, rc 0) 00000100:00100000:1.0:1789607502.448384:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:12257:x1876539130058368:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 2367us (2643us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789607502.448392:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:1.0:1789607502.456197:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607502.456399:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130058496 00000100:00100000:2.0:1789607502.456411:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130058496 00000100:00100000:2.0:1789607502.456490:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607502.456500:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:2394:x1876539130058496:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607502.456516:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607502.456757:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbdfd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a83 expref: 17 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607502.456799:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:2.0:1789607502.456812:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607502.456962:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:2394:x1876539130058496:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 462us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607502.456969:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1789607502.458367:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607502.459129:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130058624 00000100:00100000:1.0:1789607502.459140:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130058624 00000100:00100000:1.0:1789607502.459204:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:1.0:1789607502.459215:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:12257:x1876539130058624:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789607502.459323:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:12257:x1876539130058624:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 110us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607502.459330:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:1.0:1789607502.472745:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607502.477788:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130058752 00000100:00100000:3.0:1789607502.477814:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130058752 00000100:00080000:2.0:1789607502.478107:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607502.478268:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00100000:3.0:1789607502.478284:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:12257:x1876539130058752:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789607502.478386:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:12257:x1876539130058752:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 107us (5651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607502.478393:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 148 00000040:00080000:2.0:1789607502.499842:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607502.562055:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150056576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607502.562230:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607502.562298:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150056704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607502.562331:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607502.562376:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056576 00000100:00100000:1.0:1789607502.562384:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056576 00000100:00100000:1.0:1789607502.562431:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056704 00000100:00100000:1.0:1789607502.562435:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056704 00000100:00100000:1.0:1789607502.562452:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789607502.562460:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150056576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607502.562494:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607502.562543:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150056576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607502.562550:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789607502.562567:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789607502.562573:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150056704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607502.562584:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607502.562609:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150056704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607502.562614:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1789607502.562628:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607502.562660:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150056576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607502.562673:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150056704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607503.075155:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150056832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607503.076151:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607503.076467:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056832 00000100:00100000:1.0:1789607503.076475:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056832 00000100:00100000:1.0:1789607503.076623:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789607503.076631:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150056832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607503.076668:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607503.076717:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150056832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607503.076724:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789607503.076770:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150056832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789607503.077279:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789607503.129836:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1789607503.129855:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1789607503.129893:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000020:00080000:2.0:1789607503.129904:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789607503.129914:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1789607503.283244:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607503.283253:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607503.283733:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789607503.283742:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607503.586373:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607503.586398:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150056960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607503.586476:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607503.586587:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150056960 00000100:00100000:3.0:1789607503.586596:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150056960 00000100:00100000:3.0:1789607503.586650:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789607503.586660:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150056960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607503.586700:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607503.586756:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150056960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607503.586762:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789607503.587201:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fc905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150056960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789607504.098219:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607504.266127:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.268444:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130058880 00000100:00100000:3.0:1789607504.268457:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130058880 00000100:00100000:3.0:1789607504.268545:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:3.0:1789607504.268556:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:12300:x1876539130058880:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.268576:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.268594:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbdfe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a8a expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.268651:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.268665:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.268677:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.268691:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.268709:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.268717:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269068:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269077:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269083:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269089:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.269093:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269101:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269112:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:3.0:1789607504.269115:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.269120:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269125:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbdfe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269136:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269148:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269154:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269158:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.269161:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269167:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269175:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d78d9b83300) 00010000:00010000:3.0:1789607504.269178:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.269181:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269186:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbdff0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269218:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbdfe2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a8a expref: 15 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269227:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:3.0:1789607504.269229:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.269232:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbdfe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a8a expref: 15 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.269241:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f600, rc 0) 00000100:00100000:3.0:1789607504.269305:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:12300:x1876539130058880:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 751us (3186us total) trans 0 rc 301/301 00000100:00100000:3.0:1789607504.269312:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00080000:1.0:1789607504.269480:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607504.286163:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.286233:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130059136 00000100:00100000:3.0:1789607504.286243:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130059136 00000100:00100000:3.0:1789607504.286301:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:3.0:1789607504.286310:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+14:12300:x1876539130059136:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:3.0:1789607504.286360:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607504.286384:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbd96e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688ca expref: 14 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.286402:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1300) 00010000:00010000:3.0:1789607504.286412:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607504.286610:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.286623:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.286634:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.286646:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.286667:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.286674:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287695:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287708:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287717:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607504.287730:0:6470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c811716 reply state 00000000a13c063c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287740:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287746:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607504.287749:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607504.287752:0:6470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789607504.287757:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789607504.287765:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287771:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287777:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287782:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.287785:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287807:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287826:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607504.287828:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.287832:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287838:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbdff7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607504.287853:0:6470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c811716 reply state 00000000a13c063c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287884:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.287891:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d78d9b83200) 00010000:00010000:3.0:1789607504.287893:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607504.287895:0:6470:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789607504.287985:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:12300:x1876539130059136:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 1672us (1827us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789607504.287993:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:1.0:1789607504.394765:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.394949:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130059264 00000100:00100000:3.0:1789607504.394960:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130059264 00000100:00100000:3.0:1789607504.395028:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:3.0:1789607504.395039:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+15:12308:x1876539130059264:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:3.0:1789607504.395063:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.395084:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe00c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a91 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.395169:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbe013 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.395182:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbe013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.395194:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbe013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.395229:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607504.395232:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607504.395254:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbe013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.395276:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe00c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a91 expref: 17 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.395292:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbe013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a91 expref: 16 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.395299:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607504.395301:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607504.395304:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e000, rc 0) 00000100:00100000:3.0:1789607504.395362:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:12308:x1876539130059264:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 325us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.395370:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:3.0:1789607504.467282:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607504.468523:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130059392 00000100:00100000:2.0:1789607504.468535:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130059392 00000100:00100000:2.0:1789607504.468600:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:2.0:1789607504.468611:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+16:12314:x1876539130059392:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1789607504.468631:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607504.468651:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe01a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a98 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468712:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468726:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468768:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468781:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468789:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468795:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468937:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbe02f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468947:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbe02f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.468954:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbe02f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.469251:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789607504.469263:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607504.469290:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbe02f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469305:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469312:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469319:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469325:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.469329:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469336:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469348:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607504.469351:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.469355:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469361:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469375:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469382:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469399:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469404:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.469407:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469414:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469422:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d78d9b83200) 00010000:00010000:3.0:1789607504.469424:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.469428:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469433:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469460:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe01a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a98 expref: 18 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469486:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbe02f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a98 expref: 17 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.469494:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607504.469496:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607504.469498:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580400, rc 0) 00000100:00100000:3.0:1789607504.469608:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:12314:x1876539130059392:12345-192.168.203.25@tcp:101:bash.0 Request processed in 998us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.469624:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:0.0:1789607504.476119:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607504.476369:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130059648 00000100:00100000:1.0:1789607504.476379:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130059648 00000100:00100000:1.0:1789607504.476442:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 153 00000100:00100000:1.0:1789607504.476453:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+17:12314:x1876539130059648:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607504.476473:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607504.476494:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe036 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668a9f expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.476614:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.476643:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.476653:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.476670:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.476677:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.476683:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607504.477555:0:7709:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789607504.477718:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477729:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477738:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477773:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477780:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477787:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477801:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607504.477805:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477823:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477836:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:1.0:1789607504.477839:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607504.477844:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477851:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe03d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607504.477907:0:7709:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab4177d6 reply state 000000009776b4cf transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477918:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477924:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607504.477926:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607504.477929:0:7709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607504.477963:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe036 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 20 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477978:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 19 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.477996:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:1.0:1789607504.477998:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607504.478393:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185800, rc 0) 00000100:00100000:1.0:1789607504.478505:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:12314:x1876539130059648:12345-192.168.203.25@tcp:101:bash.0 Request processed in 2053us (2404us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789607504.478514:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 153 00000100:00100000:1.0:1789607504.485267:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607504.485354:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130059776 00000100:00100000:0.0:1789607504.485365:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130059776 00000100:00100000:0.0:1789607504.485444:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:0.0:1789607504.485456:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130059776:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607504.485474:0:8114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607504.485493:0:8114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668aa6 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607504.485520:0:8114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607504.485537:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1789607504.485542:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607504.485551:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 6 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.485569:0:8114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 6 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.485598:0:8114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9c00, rc 0) 00000100:00100000:0.0:1789607504.485655:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539130059776:12345-192.168.203.25@tcp:101:bash.0 Request processed in 202us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607504.485663:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00080000:1.0:1789607504.487850:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607504.493471:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607504.493739:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130059904 00000100:00100000:1.0:1789607504.493749:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130059904 00000100:00100000:1.0:1789607504.493824:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607504.493835:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:12314:x1876539130059904:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607504.493852:0:8113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607504.493902:0:8113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668aad expref: -99 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.493933:0:8113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 7 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.493942:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607504.493946:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607504.493951:0:8113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 7 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.493995:0:8113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 7 pid: 8114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.494218:0:8113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 7 pid: 8114 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607504.494232:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8113:1876539150057088:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607504.494360:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d95960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607504.500407:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.500481:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130060032 00000100:00100000:3.0:1789607504.500491:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130060032 00010000:00010000:3.0:1789607504.500533:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 8 pid: 8114 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.500573:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:3.0:1789607504.500582:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130060032:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607504.500598:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607504.500620:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 8 pid: 8114 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.500635:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 8 pid: 8114 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.500661:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607504.500665:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607504.500674:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.500684:0:6456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.500723:0:6456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.500750:0:6456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150057216:192.168.203.25@tcp:105: 00010000:00010000:1.0:1789607504.500885:0:8113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5145736/0xa26202d240fbe059 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aa6 expref: 8 pid: 8114 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607504.500901:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8113:1876539150057088:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607504.500922:0:8113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 7 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607504.500932:0:8113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184600, rc 0) 00000100:00100000:3.0:1789607504.501776:0:6456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607504.501828:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fc905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:12314:x1876539130059904:12345-192.168.203.25@tcp:101:bash.0 Request processed in 7993us (8364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607504.501836:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:3.0:1789607504.508407:0:6456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150057216:192.168.203.25@tcp:105: 00010000:00010000:3.0:1789607504.508434:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607504.508501:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130060032:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 7919us (8102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.508512:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:1.0:1789607504.508771:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.509238:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130060288 00000100:00100000:3.0:1789607504.509246:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130060288 00000100:00100000:3.0:1789607504.509290:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:3.0:1789607504.509299:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:12314:x1876539130060288:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:3.0:1789607504.509801:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:12314:x1876539130060288:12345-192.168.203.25@tcp:35:bash.0 Request processed in 492us (1019us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789607504.509809:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:1.0:1789607504.587734:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.587833:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130060544 00000100:00100000:3.0:1789607504.587843:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130060544 00000100:00100000:3.0:1789607504.587923:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 154 00000100:00100000:3.0:1789607504.587935:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:12324:x1876539130060544:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.587958:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.587978:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.588072:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789607504.588291:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe067 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ab4 expref: 23 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.588323:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607504.588326:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607504.588332:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ab4 expref: 23 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.588345:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ec00, rc 0) 00000100:00100000:3.0:1789607504.588456:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:12324:x1876539130060544:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 522us (731us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789607504.588527:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 154 00000100:00100000:0.0:1789607504.590954:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607504.591208:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130060800 00000100:00100000:2.0:1789607504.591218:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130060800 00000100:00100000:2.0:1789607504.591273:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:2.0:1789607504.591282:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:12324:x1876539130060800:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1789607504.591580:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:12324:x1876539130060800:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 299us (633us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789607504.591589:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:2.0:1789607504.672192:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.672281:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130060928 00000100:00100000:3.0:1789607504.672290:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130060928 00000100:00100000:3.0:1789607504.672349:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 155 00000100:00100000:3.0:1789607504.672359:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:12330:x1876539130060928:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.672383:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.672403:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668abb expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.672464:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe07c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.672477:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe07c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.672487:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe07c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.672522:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789607504.672538:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607504.672557:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe07c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.672580:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668abb expref: 25 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.672596:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe07c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668abb expref: 24 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.672604:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607504.672606:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607504.672609:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f600, rc 0) 00000100:00100000:3.0:1789607504.672663:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:12330:x1876539130060928:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 306us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.672670:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 155 00000100:00100000:1.0:1789607504.677028:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607504.677170:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130061184 00000100:00100000:2.0:1789607504.677181:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130061184 00000100:00100000:2.0:1789607504.677242:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:2.0:1789607504.677253:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:12330:x1876539130061184:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607504.677273:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607504.677292:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe083 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ac2 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.677392:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe08a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.677404:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe08a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.677414:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe08a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607504.677425:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789607504.677547:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe083 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac2 expref: 27 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.677565:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe08a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac2 expref: 26 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.677574:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:2.0:1789607504.677578:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607504.677581:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581000, rc 0) 00000100:00100000:2.0:1789607504.677638:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12330:x1876539130061184:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 387us (618us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789607504.677657:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:0.0:1789607504.680279:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.680821:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130061312 00000100:00100000:3.0:1789607504.680831:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130061312 00000100:00100000:3.0:1789607504.680908:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:3.0:1789607504.680926:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:2394:x1876539130061312:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607504.680941:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607504.680972:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe08a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac2 expref: 26 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.680990:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:3.0:1789607504.680995:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607504.681045:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:2394:x1876539130061312:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 122us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.681066:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1789607504.682367:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.682476:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130061568 00000100:00100000:3.0:1789607504.682484:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130061568 00000100:00100000:3.0:1789607504.682533:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:3.0:1789607504.682542:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:12330:x1876539130061568:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.682564:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.682582:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe098 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ac9 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.682674:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe09f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.682688:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe09f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.682698:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe09f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.682710:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789607504.683160:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe098 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac9 expref: 28 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.683179:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe09f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac9 expref: 27 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.683187:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:3.0:1789607504.683190:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789607504.683194:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f800, rc 0) 00000100:00100000:3.0:1789607504.683251:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+27:12330:x1876539130061568:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 711us (892us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789607504.683258:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:1.0:1789607504.690143:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.690216:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130061696 00000100:00100000:3.0:1789607504.690225:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130061696 00000100:00100000:3.0:1789607504.690270:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607504.690278:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2395:x1876539130061696:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:3.0:1789607504.690317:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.690334:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 6 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.690342:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607504.690346:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607504.690350:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.690382:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 6 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.690397:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 6 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.690410:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150057344:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607504.690496:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607504.693296:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150057344:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607504.693326:0:8112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607504.696550:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607504.696644:0:8117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130061824 00000100:00100000:2.0:1789607504.696654:0:8117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130061824 00002000:00100000:2.0:1789607504.696701:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d78fd591c00 x1876539130061824/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:60/0 lens 504/0 e 0 to 0 dl 1789607515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607504.696712:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fd591c00 with x1876539130061824 ext(0->12) 00010000:00010000:2.0:1789607504.696722:0:8117:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 7 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.696738:0:8117:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 7 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607504.696745:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d78fd591c00 00000100:00100000:2.0:1789607504.696777:0:8117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1789607504.696792:0:8117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130061824:12345-192.168.203.25@tcp:4:lfs.0 00000100:00100000:2.0:1789607504.697362:0:8117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2395:x1876539130061824:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 574us (820us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789607504.697371:0:8117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00002000:00100000:2.0:1789607504.697379:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d78fd591c00 x1876539130061824/t4294967306(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:60/0 lens 504/448 e 0 to 0 dl 1789607515 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607504.697387:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fd591c00 with x1876539130061824 ext(0->12) 00010000:00010000:2.0:1789607504.697393:0:8117:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 9 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.697415:0:8117:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 9 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607504.697423:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d78fd591c00 00000100:00100000:0.0:1789607504.701691:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.701771:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130061952 00000100:00100000:3.0:1789607504.701781:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130061952 00010000:00010000:3.0:1789607504.701842:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 9 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.701932:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:3.0:1789607504.702263:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2395:x1876539130061952:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607504.702588:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789607504.702610:0:6455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789607504.702613:0:6455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789607505 00002000:00010000:2.0:1789607504.702615:0:6455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789607505 00002000:00010000:2.0:1789607504.702616:0:6455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789607505 00010000:00010000:2.0:1789607504.702623:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 9 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.702638:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 9 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.702659:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc828eed/0xa26202d240fbe060 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aad expref: 9 pid: 8113 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.702677:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607504.702681:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607504.702687:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.702696:0:6455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.702750:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607504.702884:0:8112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.702894:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.702928:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.702937:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.702954:0:8112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.702980:0:8112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607504.702984:0:8112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.702994:0:8112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.703006:0:8112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.703013:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe0ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607504.703117:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130061952:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1174us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607504.703126:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:3.0:1789607504.703729:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130061696:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 13448us (13592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.703740:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:2.0:1789607504.707670:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.707747:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130062208 00000100:00100000:3.0:1789607504.707757:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130062208 00000100:00100000:3.0:1789607504.708492:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:3.0:1789607504.708507:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0071c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+27:12330:x1876539130062208:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:3.0:1789607504.708563:0:6471:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe09f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac9 expref: 27 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607504.708804:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789607504.708894:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789607504.709702:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1789607504.709762:0:6471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.709778:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 31 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.710174:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.710215:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 31 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.710230:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 31 pid: 7709 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.710245:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6471:1876539150057472:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607504.710336:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607504.713828:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607504.714130:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130062336 00000100:00100000:0.0:1789607504.714140:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130062336 00010000:00010000:0.0:1789607504.714180:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 32 pid: 7709 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607504.714212:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:0.0:1789607504.714221:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:2395:x1876539130062336:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607504.714235:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607504.714243:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 32 pid: 7709 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.714256:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 32 pid: 7709 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.714276:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:0.0:1789607504.714282:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.714291:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.714311:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.714330:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607504.714378:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+32:2395:x1876539130062336:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 158us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607504.714386:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00010000:00010000:3.0:1789607504.716189:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbe04b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a9f expref: 31 pid: 7709 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.716213:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6471:1876539150057472:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607504.716237:0:6471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.716351:0:6471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607504.716359:0:6471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607504.716476:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1789607504.716671:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789607504.717606:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d96680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150057600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607504.717674:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607504.717760:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31180 going to sleep for 11 seconds 00000100:00100000:1.0:1789607504.719154:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150057600 00000100:00100000:1.0:1789607504.719180:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150057600 00000100:00100000:1.0:1789607504.719349:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789607504.719360:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6471:x1876539150057600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607504.719471:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6471:x1876539150057600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607504.719478:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789607504.719595:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d96680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150057600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789607504.720217:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789607504.720294:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150057728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789607504.720338:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607504.720371:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071180 going to sleep for 11 seconds 00000100:00100000:1.0:1789607504.720645:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150057728 00000100:00100000:1.0:1789607504.720651:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150057728 00000100:00100000:1.0:1789607504.720691:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789607504.720700:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6471:x1876539150057728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607504.720888:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6471:x1876539150057728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (549us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789607504.720895:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789607504.721275:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150057728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789607504.721333:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789607504.721372:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.721382:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.721390:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.721395:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607504.721399:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.721407:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.721432:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:0.0:1789607504.721434:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789607504.721439:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607504.721444:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe0b4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607504.721701:0:6471:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789607504.721825:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789607504.721836:0:6471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409678973832ns, next at 410678971091ns, rc = 0 00000001:00080000:0.0:1789607504.721842:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789607504.721911:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78e28a4900) 00010000:00010000:0.0:1789607504.721915:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607504.721921:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe09f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ac9 expref: 35 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607504.722220:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0071c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:12330:x1876539130062208:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 13716us (14558us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789607504.722229:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000020:00080000:0.0:1789607504.722233:0:6471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789607504.724721:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.724807:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130062464 00000100:00100000:3.0:1789607504.724824:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130062464 00000100:00100000:3.0:1789607504.724925:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00100000:3.0:1789607504.724934:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:12330:x1876539130062464:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.724993:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.725014:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe0bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ad0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.725069:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe0bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ad0 expref: 35 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.725082:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe0bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ad0 expref: 35 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.725100:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607504.725103:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607504.725107:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f200, rc 0) 00000100:00100000:3.0:1789607504.725159:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:12330:x1876539130062464:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 226us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.725166:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00080000:2.0:1789607504.725690:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607504.729844:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607504.730384:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130062720 00000100:00100000:2.0:1789607504.730395:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130062720 00000100:00100000:2.0:1789607504.730482:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1789607504.730493:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:12330:x1876539130062720:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1789607504.730767:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+36:12330:x1876539130062720:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 275us (931us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789607504.730775:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:0.0:1789607504.813751:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.814136:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130062976 00000100:00100000:3.0:1789607504.814145:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130062976 00000100:00100000:3.0:1789607504.814205:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:3.0:1789607504.814215:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+36:12340:x1876539130062976:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.814239:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.814260:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ad7 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.814455:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789607504.814570:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ad7 expref: 38 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.814599:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607504.814602:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607504.814607:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ad7 expref: 38 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.814621:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ee00, rc 0) 00000100:00100000:3.0:1789607504.814752:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12340:x1876539130062976:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 538us (1011us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1789607504.814760:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:1.0:1789607504.818037:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.818168:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130063104 00000100:00100000:3.0:1789607504.818177:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130063104 00000100:00100000:3.0:1789607504.818257:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:3.0:1789607504.818266:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12340:x1876539130063104:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:3.0:1789607504.818339:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818355:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818365:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818374:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818381:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818402:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818477:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818484:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818491:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607504.818529:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818540:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818547:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818553:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818559:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.818563:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818570:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818580:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607504.818587:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.818592:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818598:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818610:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818616:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818622:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818626:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.818629:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818634:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818640:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:3.0:1789607504.818642:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.818645:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818650:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818657:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818778:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818785:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818797:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.818800:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818807:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818822:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607504.818824:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.818827:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.818833:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.818934:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12340:x1876539130063104:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 669us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.818942:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:0.0:1789607504.821236:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607504.821383:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130063360 00000100:00100000:2.0:1789607504.821393:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130063360 00000100:00100000:2.0:1789607504.821490:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:2.0:1789607504.821500:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12340:x1876539130063360:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1789607504.821729:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:12340:x1876539130063360:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 230us (499us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789607504.821736:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:2.0:1789607504.867168:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.867255:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130063616 00000100:00100000:3.0:1789607504.867266:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130063616 00000100:00100000:3.0:1789607504.867328:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:3.0:1789607504.867340:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:12343:x1876539130063616:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607504.867363:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607504.867395:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ade expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867485:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867500:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867512:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867523:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867530:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867536:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867648:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867657:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867663:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607504.867673:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789607504.867766:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867783:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867804:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867820:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.867824:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867832:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867844:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607504.867847:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.867851:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867857:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe0ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867966:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867972:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867977:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867982:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.867990:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.867995:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.868003:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:3.0:1789607504.868005:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607504.868008:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.868013:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe0f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.868049:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe0e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 41 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.868062:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 40 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.868069:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607504.868072:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607504.868074:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ee00, rc 0) 00000100:00100000:3.0:1789607504.868173:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12343:x1876539130063616:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 836us (1012us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789607504.868180:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:0.0:1789607504.871383:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607504.871477:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130063744 00000100:00100000:3.0:1789607504.871486:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130063744 00000100:00100000:3.0:1789607504.871586:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 162 00000100:00100000:3.0:1789607504.871597:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12343:x1876539130063744:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1789607504.871673:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871691:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871702:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871726:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871734:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871740:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871747:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607504.871751:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871758:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871769:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607504.871772:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607504.871776:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607504.871782:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe108 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607504.872092:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12343:x1876539130063744:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 496us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607504.872100:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 162 00000100:00100000:0.0:1789607504.874650:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607504.874752:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130064000 00000100:00100000:1.0:1789607504.874762:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130064000 00000100:00100000:1.0:1789607504.875177:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:1.0:1789607504.875189:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12343:x1876539130064000:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607504.875410:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:12343:x1876539130064000:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 223us (769us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789607504.875418:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1789607505.121650:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.121733:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130064256 00000100:00100000:3.0:1789607505.121742:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130064256 00000100:00100000:3.0:1789607505.122117:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 163 00000100:00100000:3.0:1789607505.122130:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:12374:x1876539130064256:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:3.0:1789607505.122153:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607505.122175:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe10f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ae5 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.122274:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.122288:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.122300:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607505.122312:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789607505.122436:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe10f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ae5 expref: 44 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.122453:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ae5 expref: 43 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.122461:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.122476:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607505.122480:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902052c00, rc 0) 00000100:00100000:3.0:1789607505.122539:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12374:x1876539130064256:12345-192.168.203.25@tcp:101:cat.0 Request processed in 414us (898us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789607505.122546:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 163 00010000:00010000:2.0:1789607505.126388:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607505.126481:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607505.126516:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.126605:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130064512 00000100:00100000:2.0:1789607505.126613:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130064512 00000100:00100000:2.0:1789607505.126669:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:2.0:1789607505.126679:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12374:x1876539130064512:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:2.0:1789607505.126998:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:12374:x1876539130064512:12345-192.168.203.25@tcp:35:cat.0 Request processed in 319us (521us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789607505.127005:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1789607505.137596:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130064640 00000100:00100000:3.0:1789607505.137612:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130064640 00000100:00100000:3.0:1789607505.137695:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1789607505.137707:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:2396:x1876539130064640:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607505.137722:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607505.137748:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ae5 expref: 44 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.137767:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.137772:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607505.137844:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:2396:x1876539130064640:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 140us (11326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607505.137852:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:1.0:1789607505.188043:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.188139:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130064896 00000100:00100000:3.0:1789607505.188149:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130064896 00000100:00100000:3.0:1789607505.188204:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 164 00000100:00100000:3.0:1789607505.188214:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12380:x1876539130064896:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:3.0:1789607505.188237:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607505.188240:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789607505.188266:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe07c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668abb expref: 43 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.188298:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607505.188303:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607505.188317:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe124 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668aec expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.188407:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.188420:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 43 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.188429:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.188458:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 43 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.188480:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 43 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607505.188494:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150057856:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607505.188577:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607505.191795:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.192286:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065024 00000100:00100000:2.0:1789607505.192296:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065024 00010000:00010000:2.0:1789607505.192336:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 44 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607505.192376:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:2.0:1789607505.192386:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:2396:x1876539130065024:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607505.192400:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607505.192408:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 44 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.192442:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 44 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.192466:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607505.192763:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.192774:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.192782:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.193371:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe0fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ade expref: 44 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607505.193389:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150057856:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607505.193425:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607505.193640:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607505.193705:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:2396:x1876539130065024:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1319us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607505.193720:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00010000:00010000:3.0:1789607505.195203:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.195218:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607505.195241:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789607505.195409:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe124 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 44 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.195431:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 43 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.195440:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.195443:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607505.195447:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7902053200, rc 0) 00000100:00100000:3.0:1789607505.195577:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12380:x1876539130064896:12345-192.168.203.25@tcp:101:dd.0 Request processed in 7363us (7542us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789607505.195586:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 164 00000100:00100000:0.0:1789607505.200064:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.200139:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065280 00000100:00100000:3.0:1789607505.200148:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065280 00000100:00100000:3.0:1789607505.200203:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00100000:3.0:1789607505.200213:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12380:x1876539130065280:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:3.0:1789607505.200514:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.200544:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.200555:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607505.200604:0:6470:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789607505.200629:0:6470:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd8a17d2 reply state 000000004cdea6f1 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.200641:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.200649:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.200652:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607505.200656:0:6470:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607505.200741:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:12380:x1876539130065280:12345-192.168.203.25@tcp:36:dd.0 Request processed in 528us (685us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789607505.200748:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 165 00000020:00080000:3.0:1789607505.200753:0:6470:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607505.418378:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.418428:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.418460:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607505.418629:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065536 00000100:00100000:0.0:1789607505.418650:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065536 00000100:00100000:0.0:1789607505.418694:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130066048 00000100:00100000:0.0:1789607505.418697:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130066048 00000100:00100000:0.0:1789607505.418729:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 325 00000100:00100000:1.0:1789607505.418741:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065792 00000100:00100000:0.0:1789607505.418741:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:2396:x1876539130065536:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607505.418748:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065792 00000100:00100000:1.0:1789607505.418783:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:1.0:1789607505.418792:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130065792:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607505.418838:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130065792:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 46us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607505.418845:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:0.0:1789607505.418904:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:2396:x1876539130065536:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 89us (458us total) trans 0 rc 0/0 00000100:00080000:1.0:1789607505.418906:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607505.418916:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 325 00000100:00100000:1.0:1789607505.418924:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 326 00000100:00100000:1.0:1789607505.418933:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130066048:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607505.418961:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130066048:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607505.418968:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 326 00000100:00100000:2.0:1789607505.419341:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.419372:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.419396:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.419437:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.419619:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065920 00000100:00100000:3.0:1789607505.419627:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065920 00000100:00100000:3.0:1789607505.419673:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:3.0:1789607505.419680:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130065920:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607505.419717:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130065920:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607505.419723:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00080000:2.0:1789607505.419782:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607505.419916:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065408 00000100:00100000:0.0:1789607505.419921:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065408 00000100:00100000:0.0:1789607505.419952:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 385 00000100:00100000:0.0:1789607505.419959:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130065408:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607505.420036:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130065408:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 77us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.420042:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 385 00000100:00100000:0.0:1789607505.420070:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130065664 00000100:00100000:0.0:1789607505.420073:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130065664 00000100:00100000:0.0:1789607505.420100:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130066176 00000100:00100000:0.0:1789607505.420103:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130066176 00000100:00100000:0.0:1789607505.420124:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 327 00000100:00100000:0.0:1789607505.420130:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130065664:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607505.420155:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130065664:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.420162:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 327 00000100:00100000:0.0:1789607505.420174:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 328 00000100:00100000:0.0:1789607505.420180:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130066176:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607505.420217:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130066176:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 37us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.420223:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 328 00000100:00080000:0.0:1789607505.420238:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607505.502041:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.502173:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130066304 00000100:00100000:3.0:1789607505.502195:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130066304 00000100:00100000:3.0:1789607505.502256:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:3.0:1789607505.502266:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:12394:x1876539130066304:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:3.0:1789607505.502286:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607505.502315:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe140 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668af3 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502380:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502394:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502406:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502416:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502423:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502430:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502515:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502526:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 47 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502535:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502573:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 47 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.502586:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 47 pid: 12196 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607505.502599:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150057984:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607505.502684:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607505.509580:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607505.509641:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130066560 00000100:00100000:1.0:1789607505.509651:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130066560 00000100:00100000:3.0:1789607505.509676:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150057984:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607505.509703:0:6469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607505.509707:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:1.0:1789607505.509716:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+48:6371:x1876539130066560:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789607505.510179:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+49:6371:x1876539130066560:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 462us (608us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789607505.510188:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:2.0:1789607505.512475:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.512565:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130066688 00000100:00100000:3.0:1789607505.512573:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130066688 00010000:00010000:3.0:1789607505.512612:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 49 pid: 12196 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607505.512680:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1789607505.512691:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+49:2395:x1876539130066688:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607505.512705:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607505.512712:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 49 pid: 12196 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.512724:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 49 pid: 12196 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.512765:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053200/0xa26202d240fbe12b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668aec expref: 49 pid: 12196 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.512779:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.512856:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.512895:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.512902:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.513066:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607505.513117:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+48:2395:x1876539130066688:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 428us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607505.513124:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00010000:00010000:0.0:1789607505.513180:0:6469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513189:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607505.513231:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789607505.513234:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607505.513254:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513264:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513271:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513275:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513279:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513283:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607505.513285:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513292:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513310:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607505.513312:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607505.513317:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513322:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe147 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513334:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513341:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513347:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513352:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607505.513355:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513366:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513374:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607505.513376:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607505.513378:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513383:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe14e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513423:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902052c00/0xa26202d240fbe140 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668af3 expref: 48 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513435:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668af3 expref: 47 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.513441:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607505.513443:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607505.513445:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ec00, rc 0) 00000100:00100000:0.0:1789607505.514906:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:12394:x1876539130066304:12345-192.168.203.25@tcp:101:stat.0 Request processed in 11205us (11438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.514926:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:2.0:1789607505.573956:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607505.574030:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130066944 00000100:00100000:3.0:1789607505.574039:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130066944 00000100:00100000:3.0:1789607505.574091:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:3.0:1789607505.574100:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:12400:x1876539130066944:12345-192.168.203.25@tcp:36:truncate.0 00010000:00010000:3.0:1789607505.574149:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607505.574172:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe155 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668af3 expref: 47 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.574189:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.574193:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607505.574399:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.574412:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.574421:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607505.574461:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789607505.574480:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c655072 reply state 0000000007636d7c transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.574491:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607505.574497:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607505.574500:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607505.574502:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607505.574581:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+49:12400:x1876539130066944:12345-192.168.203.25@tcp:36:truncate.0 Request processed in 482us (633us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789607505.574589:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 167 00000020:00080000:3.0:1789607505.574593:0:12196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607505.634259:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607505.634282:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150058112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607505.634359:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607505.637166:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058112 00000100:00100000:1.0:1789607505.637171:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607505.637182:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058112 00000100:00100000:1.0:1789607505.637193:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150058240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607505.637242:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789607505.637252:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150058112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607505.637257:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789607505.637286:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607505.637327:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150058112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.637334:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789607505.637348:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058240 00000100:00100000:0.0:1789607505.637351:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058240 00000100:00100000:0.0:1789607505.637366:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789607505.637372:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150058240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607505.637383:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607505.637394:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789607505.637399:0:3469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78fd116a00, transno 4294967313 00000100:00100000:0.0:1789607505.637411:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150058240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607505.637414:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150058112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607505.637424:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1789607505.637438:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607505.637462:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150058240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607505.638077:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150058368:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.638115:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607505.638281:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150058624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638320:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607505.638339:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150059136:0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638361:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607505.638379:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150059648:0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638399:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607505.638419:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789607505.638424:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150058752:0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638444:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607505.638458:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150059264:0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638478:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607505.638508:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150059264 00000100:00100000:2.0:1789607505.638513:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150059264 00000100:00100000:2.0:1789607505.638560:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789607505.638568:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150059264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638614:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150059264:12345-0@lo:400:kworker.0 Request processed in 47us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607505.638621:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789607505.638640:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607505.638669:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150059264:0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638692:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150059136 00000100:00100000:2.0:1789607505.638695:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150059136 00000100:00100000:2.0:1789607505.638722:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150059648 00000100:00100000:2.0:1789607505.638725:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150059648 00000100:00100000:2.0:1789607505.638743:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058752 00000100:00100000:2.0:1789607505.638745:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058752 00000100:00100000:2.0:1789607505.638758:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789607505.638775:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150059136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638825:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150059136:12345-0@lo:400:kworker.0 Request processed in 50us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607505.638831:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789607505.638842:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789607505.638848:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150059648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638901:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150059648:12345-0@lo:400:kworker.0 Request processed in 53us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607505.638907:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789607505.638918:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789607505.638924:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150058752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607505.638950:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150058752:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607505.638955:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789607505.639069:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f7573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150058880:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639098:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607505.639119:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150059392:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639139:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607505.639158:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789607505.639165:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78efaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150058496:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639185:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607505.639197:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150059008:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639218:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607505.639229:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150059520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639249:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607505.639268:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150059392 00000100:00100000:0.0:1789607505.639272:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150059392 00000100:00100000:0.0:1789607505.639298:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789607505.639304:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150059392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639339:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150059392:12345-0@lo:400:kworker.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.639346:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789607505.639364:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058624 00000100:00100000:0.0:1789607505.639375:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058624 00000100:00100000:0.0:1789607505.639400:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058880 00000100:00100000:0.0:1789607505.639403:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058880 00000100:00100000:0.0:1789607505.639418:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789607505.639424:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150058624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639458:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150058624:12345-0@lo:400:kworker.0 Request processed in 34us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.639464:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789607505.639477:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789607505.639483:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150058880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639510:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150058880:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.639515:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789607505.639542:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150058880:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639553:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150059392:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639576:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058496 00000100:00100000:0.0:1789607505.639579:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058496 00000100:00100000:0.0:1789607505.639595:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150059008 00000100:00100000:0.0:1789607505.639597:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150059008 00000100:00100000:0.0:1789607505.639609:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150059520 00000100:00100000:0.0:1789607505.639611:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150059520 00000100:00100000:0.0:1789607505.639622:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789607505.639628:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150058496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639660:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150058496:12345-0@lo:400:kworker.0 Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.639666:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789607505.639687:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150058496:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639714:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789607505.639721:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150059008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639755:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150059008:12345-0@lo:400:kworker.0 Request processed in 34us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.639760:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789607505.639782:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150059008:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639799:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789607505.639816:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.639850:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150059520:12345-0@lo:400:kworker.0 Request processed in 46us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.639856:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789607505.639902:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150059520:0@lo:400:kworker.0 00000100:00080000:0.0:1789607505.639939:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607505.639943:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607505.640072:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150058752:0@lo:400:kworker.0 00000100:00100000:0.0:1789607505.640084:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f7571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150058624:0@lo:400:kworker.0 00010000:00080000:0.0:1789607505.640098:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8e0a80 x1876539150059136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607505.640109:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150059136:0@lo:400:kworker.0 00010000:00080000:0.0:1789607505.640120:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa629180 x1876539150059648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607505.640129:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150059648:0@lo:400:kworker.0 00000100:00100000:3.0:1789607505.640340:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150058368 00000100:00100000:3.0:1789607505.640346:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150058368 00000100:00100000:3.0:1789607505.640386:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789607505.640393:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150058368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607505.640437:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3470:x1876539150058368:12345-0@lo:400:kworker.0 Request processed in 45us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607505.640443:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789607505.640586:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78efaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150058368:0@lo:400:kworker.0 00000100:00100000:1.0:1789607505.705044:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607505.705148:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130067072 00000100:00100000:0.0:1789607505.705158:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130067072 00000100:00100000:0.0:1789607505.705221:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:0.0:1789607505.705232:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+49:12414:x1876539130067072:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:0.0:1789607505.705255:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607505.705276:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668afa expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705339:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705353:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705364:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705376:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705384:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705391:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705610:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705622:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705647:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607505.705681:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789607505.705686:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607505.705704:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705715:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705722:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705729:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705735:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705740:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607505.705744:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705750:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705761:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607505.705764:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607505.705768:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705918:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe16a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705934:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705939:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705945:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705949:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607505.705953:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705958:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705966:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607505.705969:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607505.705972:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.705978:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe171 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.706004:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 51 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.706018:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 50 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.706032:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607505.706035:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607505.706038:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:0.0:1789607505.706212:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:12414:x1876539130067072:12345-192.168.203.25@tcp:101:stat.0 Request processed in 981us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.706221:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:2.0:1789607505.793992:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607505.794137:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130067328 00000100:00100000:0.0:1789607505.794148:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130067328 00000100:00100000:0.0:1789607505.794209:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:0.0:1789607505.794220:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+50:12424:x1876539130067328:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607505.794241:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607505.794261:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe17f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b01 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607505.794352:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789607505.794479:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe17f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b01 expref: 52 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.794492:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:0.0:1789607505.794495:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607505.794500:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe17f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b01 expref: 52 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.794513:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:0.0:1789607505.794574:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:12424:x1876539130067328:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 356us (592us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1789607505.794595:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:3.0:1789607505.797351:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607505.798103:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130067584 00000100:00100000:0.0:1789607505.798117:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130067584 00000100:00100000:0.0:1789607505.798185:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:0.0:1789607505.798196:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0070050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+51:12424:x1876539130067584:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607505.798430:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0070050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:12424:x1876539130067584:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 235us (1086us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789607505.798438:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1789607505.880978:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.882174:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130067840 00000100:00100000:2.0:1789607505.882187:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130067840 00000100:00100000:2.0:1789607505.882290:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:2.0:1789607505.882302:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:12430:x1876539130067840:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1789607505.882326:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607505.882347:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe18d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b08 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.882441:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.882456:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 53 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.882584:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.882623:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 53 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.882638:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 53 pid: 6469 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607505.882652:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150059776:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607505.882749:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f64036c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607505.888589:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607505.888642:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150059776:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607505.888671:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607505.888904:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130067968 00000100:00100000:0.0:1789607505.888911:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130067968 00010000:00010000:0.0:1789607505.888946:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 54 pid: 6469 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607505.888988:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:0.0:1789607505.888996:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+54:2395:x1876539130067968:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607505.889009:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607505.889015:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 54 pid: 6469 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.889027:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 54 pid: 6469 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.889048:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe178 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668afa expref: 54 pid: 6469 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.889062:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607505.889079:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.889088:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.889096:0:7268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.889122:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607505.889226:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.889235:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607505.889252:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:2395:x1876539130067968:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 256us (675us total) trans 0 rc 0/0 00000004:00200000:2.0:1789607505.889253:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:0.0:1789607505.889259:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00010000:00010000:2.0:1789607505.889668:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe18d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 54 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.889685:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 53 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.889693:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607505.889696:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607505.889698:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581800, rc 0) 00000100:00100000:2.0:1789607505.889731:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:12430:x1876539130067840:12345-192.168.203.25@tcp:101:bash.0 Request processed in 7433us (8764us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789607505.889738:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:3.0:1789607505.893183:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607505.893255:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130068224 00000100:00100000:0.0:1789607505.893263:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130068224 00000100:00100000:0.0:1789607505.893318:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 171 00000100:00100000:0.0:1789607505.893327:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:12430:x1876539130068224:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:0.0:1789607505.893596:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.893614:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.893625:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607505.893677:0:6469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1789607505.893703:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038e8a0f9 reply state 000000006d081b29 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.893715:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.893734:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607505.893736:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789607505.893740:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607505.893838:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:12430:x1876539130068224:12345-192.168.203.25@tcp:36:bash.0 Request processed in 511us (662us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789607505.893845:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 171 00000020:00080000:0.0:1789607505.893850:0:6469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607505.899683:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607505.899777:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130068352 00000100:00100000:0.0:1789607505.899797:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130068352 00000100:00100000:0.0:1789607505.899903:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 172 00000100:00100000:0.0:1789607505.899926:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:12430:x1876539130068352:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607505.899951:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607505.899982:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b0f expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.900061:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.900076:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 57 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.900085:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.900116:0:6470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 57 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.900130:0:6470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 57 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607505.900159:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150059904:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607505.900280:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0ef69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607505.904816:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607505.904899:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130068480 00000100:00100000:2.0:1789607505.904910:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130068480 00010000:00010000:2.0:1789607505.904950:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 58 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607505.905001:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 85 00000100:00100000:2.0:1789607505.905012:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:2396:x1876539130068480:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607505.905027:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607505.905034:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 58 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.905047:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 58 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.905069:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607505.905074:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.905084:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.905092:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607505.905110:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607505.905168:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:2396:x1876539130068480:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 158us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607505.905189:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 85 00010000:00010000:0.0:1789607505.906293:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe194 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b08 expref: 57 pid: 6468 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607505.906314:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150059904:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607505.906334:0:6470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.906342:0:6470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.906348:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607505.906392:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789607505.906396:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607505.906414:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.906444:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b0f expref: 57 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.906457:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b0f expref: 56 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607505.906465:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607505.906480:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607505.906484:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8200, rc 0) 00000100:00100000:0.0:1789607505.906539:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:12430:x1876539130068352:12345-192.168.203.25@tcp:101:bash.0 Request processed in 6626us (6866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607505.906546:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 172 00000100:00100000:3.0:1789607505.909920:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607505.910108:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130068736 00000100:00100000:1.0:1789607505.910118:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130068736 00000100:00100000:1.0:1789607505.910178:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:1.0:1789607505.910190:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:12430:x1876539130068736:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:1.0:1789607505.910433:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:12430:x1876539130068736:12345-192.168.203.25@tcp:35:bash.0 Request processed in 245us (532us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789607505.910441:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1789607506.004987:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607506.005199:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130068992 00000100:00100000:2.0:1789607506.005209:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130068992 00000100:00100000:2.0:1789607506.005299:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 173 00000100:00100000:2.0:1789607506.005310:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:12440:x1876539130068992:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607506.005335:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607506.005355:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b16 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607506.005449:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789607506.005568:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b16 expref: 59 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.005582:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:2.0:1789607506.005585:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607506.005591:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b16 expref: 59 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.005605:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581200, rc 0) 00000100:00100000:2.0:1789607506.005667:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:12440:x1876539130068992:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 359us (689us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789607506.005674:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 173 00000100:00080000:0.0:1789607506.006164:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607506.015433:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607506.015727:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130069120 00000100:00100000:0.0:1789607506.015738:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130069120 00000100:00100000:0.0:1789607506.015814:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 174 00000100:00100000:0.0:1789607506.015824:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:12440:x1876539130069120:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1789607506.015932:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.015949:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.015972:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.015992:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.015999:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016005:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016089:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016113:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016120:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607506.016162:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016175:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016181:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016189:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016195:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607506.016199:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016206:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016217:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607506.016220:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607506.016224:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016231:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016249:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016255:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016261:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016266:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607506.016268:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016274:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016281:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607506.016283:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607506.016285:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016290:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016297:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016302:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016307:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016320:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607506.016322:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016327:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016334:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607506.016337:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607506.016340:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.016345:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607506.016650:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:12440:x1876539130069120:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 825us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607506.016658:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 174 00000100:00100000:3.0:1789607506.026757:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607506.036349:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130069376 00000100:00100000:1.0:1789607506.036363:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130069376 00000100:00100000:1.0:1789607506.036424:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:1.0:1789607506.036434:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+58:12440:x1876539130069376:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607506.036685:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:12440:x1876539130069376:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 252us (9936us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789607506.036693:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1789607506.144984:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607506.145155:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130069632 00000100:00100000:0.0:1789607506.145165:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130069632 00000100:00100000:0.0:1789607506.145225:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 175 00000100:00100000:0.0:1789607506.145236:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:12443:x1876539130069632:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607506.145261:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607506.145281:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b1d expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145353:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145386:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145400:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145413:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145420:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145426:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145545:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe1ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145567:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe1ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145576:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe1ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607506.145594:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789607506.145691:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145700:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145707:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145720:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607506.145725:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145732:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145742:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607506.145745:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607506.145749:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145755:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe1e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145768:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145773:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145792:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145798:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607506.145833:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145841:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.145859:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607506.146357:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607506.146362:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.146369:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe1e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.146418:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe1da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b1d expref: 62 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.146432:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe1ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b1d expref: 61 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.146439:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607506.146441:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607506.146444:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9a00, rc 0) 00000100:00100000:0.0:1789607506.146516:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:12443:x1876539130069632:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1282us (1541us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789607506.146525:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 175 00010000:00010000:2.0:1789607506.146953:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607506.149083:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607506.149142:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607506.153131:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130069760 00000100:00100000:0.0:1789607506.153145:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130069760 00000100:00100000:0.0:1789607506.153221:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1789607506.153230:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:2395:x1876539130069760:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607506.153250:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607506.153273:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe1ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b1d expref: 61 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.153313:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607506.153318:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607506.153390:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:2395:x1876539130069760:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 160us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607506.153397:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1789607506.153496:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130069888 00000100:00100000:2.0:1789607506.153501:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130069888 00000100:00100000:2.0:1789607506.153530:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 176 00000100:00100000:2.0:1789607506.153537:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:12443:x1876539130069888:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:2.0:1789607506.153610:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153626:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153635:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153657:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153664:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153671:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153677:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607506.153682:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153689:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153696:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607506.153698:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607506.153702:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.153707:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe1fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607506.153750:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:12443:x1876539130069888:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 213us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607506.153756:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 176 00000100:00100000:2.0:1789607506.159959:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607506.161842:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130070144 00000100:00100000:1.0:1789607506.161857:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130070144 00000100:00100000:1.0:1789607506.161947:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:1.0:1789607506.161972:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:12443:x1876539130070144:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607506.162216:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:12443:x1876539130070144:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 246us (2266us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789607506.162224:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:3.0:1789607506.346548:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607506.346663:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130070400 00000100:00100000:0.0:1789607506.346674:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130070400 00000100:00100000:0.0:1789607506.346738:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 177 00000100:00100000:0.0:1789607506.346749:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:12461:x1876539130070400:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:0.0:1789607506.346782:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607506.346810:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe204 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b24 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.346937:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe20b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.346953:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.346964:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe20b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607506.346975:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789607506.347098:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe204 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b24 expref: 64 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.347117:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe20b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b24 expref: 63 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607506.347145:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607506.347148:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789607506.347151:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8600, rc 0) 00000100:00100000:0.0:1789607506.347212:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12461:x1876539130070400:12345-192.168.203.25@tcp:101:cat.0 Request processed in 465us (674us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789607506.347218:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 177 00000100:00100000:3.0:1789607506.380485:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607506.380600:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130070528 00000100:00100000:1.0:1789607506.380610:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130070528 00000100:00100000:1.0:1789607506.380666:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 178 00000100:00100000:1.0:1789607506.380676:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12462:x1876539130070528:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607506.380700:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607506.380719:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b2b expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.380792:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe220 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.380814:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.380827:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607506.380890:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789607506.380894:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607506.380915:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.380940:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b2b expref: 65 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.380992:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b2b expref: 64 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.381000:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:1.0:1789607506.381003:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607506.381006:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:1.0:1789607506.381079:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12462:x1876539130070528:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 404us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607506.381087:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 178 00000100:00100000:2.0:1789607506.391816:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607506.391908:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130070912 00000100:00100000:1.0:1789607506.391918:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130070912 00000100:00100000:1.0:1789607506.391976:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:1.0:1789607506.391986:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12462:x1876539130070912:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607506.392298:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12462:x1876539130070912:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 313us (499us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789607506.392306:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:3.0:1789607506.394283:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607506.394429:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071040 00000100:00100000:2.0:1789607506.394439:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071040 00000100:00100000:2.0:1789607506.394500:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:2.0:1789607506.394510:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12462:x1876539130071040:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:2.0:1789607506.394525:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789607506.394549:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe1b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b0f expref: 65 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.394571:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe20b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b24 expref: 64 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.394582:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe0bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ad0 expref: 63 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.394592:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607506.394597:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607506.394653:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:12462:x1876539130071040:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 144us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607506.394661:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:1.0:1789607506.398352:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607506.398488:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071168 00000100:00100000:2.0:1789607506.398497:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071168 00000100:00100000:2.0:1789607506.398566:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:2.0:1789607506.398577:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:12462:x1876539130071168:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1789607506.398673:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.398690:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607506.398701:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607506.399095:0:7709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789607506.399191:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:12462:x1876539130071168:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 615us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607506.399199:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:0.0:1789607506.429439:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607506.429586:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071296 00000100:00100000:1.0:1789607506.429596:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071296 00000100:00100000:1.0:1789607506.429655:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00100000:1.0:1789607506.429665:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:12464:x1876539130071296:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607506.429684:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607506.429704:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe22e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b32 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429796:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429820:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429832:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429843:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429851:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429858:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.429993:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430002:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430009:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607506.430301:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789607506.430306:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607506.430329:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430354:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430364:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430371:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430377:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430383:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607506.430387:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430395:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430407:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:1.0:1789607506.430410:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607506.430415:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430422:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe235 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430435:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430441:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430453:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430459:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607506.430462:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430531:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430542:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607506.430544:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607506.430548:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430554:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe23c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430585:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe22e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 64 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430600:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 63 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607506.430606:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:1.0:1789607506.430608:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607506.430611:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185400, rc 0) 00000100:00100000:1.0:1789607506.430669:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12464:x1876539130071296:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1006us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607506.430684:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 180 00000001:00080000:1.0:1789607506.723833:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1789607506.724020:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00010000:00010000:1.0:1789607507.170735:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607507.187004:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607507.187013:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607507.187064:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789607507.187069:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789607507.366226:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607507.366233:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607507.366665:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789607507.366672:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607507.366785:0:13335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77d1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150060032:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607507.366908:0:13335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607507.383317:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607507.383402:0:13335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77d1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150060032:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607507.383692:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071424 00000100:00100000:3.0:1789607507.383700:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071424 00000100:00100000:3.0:1789607507.383760:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 181 00000100:00100000:3.0:1789607507.383769:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12476:x1876539130071424:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789607507.383809:0:6468:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789607507.384161:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12476:x1876539130071424:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 392us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607507.384169:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 181 00000100:00100000:3.0:1789607507.390367:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607507.396198:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071552 00000100:00100000:0.0:1789607507.396213:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071552 00000100:00100000:0.0:1789607507.398534:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 182 00000100:00100000:0.0:1789607507.398551:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12476:x1876539130071552:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789607507.398621:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398649:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398677:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398695:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398704:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398711:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398738:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398746:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398753:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607507.398803:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789607507.398808:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607507.398822:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398834:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398841:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398859:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398886:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607507.398890:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398898:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398924:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:0.0:1789607507.398928:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607507.398933:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398939:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe24a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398950:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398957:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398963:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398968:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607507.398971:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.398989:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399000:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8d78c73e1b00) 00010000:00010000:0.0:1789607507.399003:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607507.399006:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399013:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe251 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399029:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399035:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399041:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399046:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607507.399049:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399054:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399062:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607507.399064:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607507.399067:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.399083:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe258 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607507.399162:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12476:x1876539130071552:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 616us (8908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.399171:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 182 00000100:00100000:0.0:1789607507.403247:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.403357:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071808 00000100:00100000:3.0:1789607507.403367:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071808 00000100:00100000:3.0:1789607507.403428:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 183 00000100:00100000:3.0:1789607507.403452:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12476:x1876539130071808:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607507.403472:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607507.403491:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe25f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b39 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403586:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403601:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403613:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607507.403625:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789607507.403722:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403730:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403737:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403743:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.403747:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403754:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403766:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607507.403774:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607507.403780:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403787:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403837:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe25f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b39 expref: 65 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403847:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:3.0:1789607507.403850:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607507.403853:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe25f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b39 expref: 65 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.403879:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607507.403937:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12476:x1876539130071808:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 488us (698us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1789607507.403944:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 183 00000100:00100000:0.0:1789607507.409762:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.409818:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130071936 00000100:00100000:3.0:1789607507.409829:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130071936 00000100:00100000:3.0:1789607507.409894:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:3.0:1789607507.409905:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12476:x1876539130071936:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789607507.409938:0:6468:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789607507.410048:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12476:x1876539130071936:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607507.410056:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:0.0:1789607507.418689:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607507.420238:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130072192 00000100:00100000:2.0:1789607507.420252:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130072192 00000100:00100000:2.0:1789607507.420323:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:2.0:1789607507.420334:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12476:x1876539130072192:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607507.420358:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607507.420361:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789607507.420387:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe220 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b2b expref: 64 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.420409:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607507.420414:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607507.420427:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe274 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b40 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607507.420834:0:6470:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789607507.421061:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe27b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.421076:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe27b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.421086:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe27b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.421139:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe274 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b40 expref: 66 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.421154:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe27b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b40 expref: 65 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.421160:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c500) 00010000:00010000:2.0:1789607507.421163:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607507.421165:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581e00, rc 0) 00000100:00100000:2.0:1789607507.421226:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12476:x1876539130072192:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 894us (2547us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789607507.421234:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:1.0:1789607507.432125:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.432382:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130072448 00000100:00100000:3.0:1789607507.432402:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130072448 00000100:00100000:3.0:1789607507.432459:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 186 00000100:00100000:3.0:1789607507.432470:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f62f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12476:x1876539130072448:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607507.432522:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607507.432650:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe27b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b40 expref: 65 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.432667:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c500) 00010000:00010000:3.0:1789607507.432678:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607507.432699:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.432713:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.432724:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.432738:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.432745:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.432752:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433096:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433104:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433117:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433122:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.433126:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433133:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433141:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607507.433144:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.433148:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433154:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe289 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433164:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433170:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433176:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433181:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.433184:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433199:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433207:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x1da3f3aa (ffff8d78d9b83000) 00010000:00010000:3.0:1789607507.433209:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.433212:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.433217:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe290 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1da3f3aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607507.433381:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f62f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12476:x1876539130072448:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 911us (1264us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607507.433389:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 186 00000100:00100000:0.0:1789607507.435670:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607507.435750:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130072576 00000100:00100000:2.0:1789607507.435760:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130072576 00000100:00100000:2.0:1789607507.436179:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 187 00000100:00100000:2.0:1789607507.436191:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12476:x1876539130072576:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607507.436212:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607507.436249:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe297 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b47 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.436285:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.436297:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.436308:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.436399:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe297 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 66 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.436417:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 65 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.436426:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:2.0:1789607507.436429:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607507.436433:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607507.436571:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12476:x1876539130072576:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 383us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607507.436578:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 187 00000100:00100000:2.0:1789607507.443594:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.443663:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130072832 00000100:00100000:3.0:1789607507.443673:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130072832 00000100:00100000:3.0:1789607507.443760:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:3.0:1789607507.443837:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12476:x1876539130072832:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607507.444558:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.444578:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.444590:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607507.445043:0:7709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789607507.445054:0:7709:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412402191789ns, next at 413402189529ns, rc = 0 00000004:00010000:3.0:1789607507.445147:0:7709:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd5ec119 reply state 00000000df6dfd92 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.445161:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.445169:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:3.0:1789607507.445172:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789607507.445176:0:7709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607507.445280:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12476:x1876539130072832:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 1508us (1694us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789607507.445289:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:2.0:1789607507.447657:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.447745:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130072960 00000100:00100000:3.0:1789607507.447754:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130072960 00000100:00100000:0.0:1789607507.448037:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:0.0:1789607507.448050:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12476:x1876539130072960:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607507.448073:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607507.448094:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b4e expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.448152:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 68 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.448846:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 68 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.449147:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:0.0:1789607507.449151:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607507.449155:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9e00, rc 0) 00000100:00100000:0.0:1789607507.449257:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:12476:x1876539130072960:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1210us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.449278:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:2.0:1789607507.451682:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.451772:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130073088 00000100:00100000:3.0:1789607507.451782:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130073088 00000100:00100000:3.0:1789607507.451919:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:3.0:1789607507.451930:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130073088:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789607507.452470:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130073088:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 540us (793us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789607507.452478:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00080000:0.0:1789607507.455277:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607507.455394:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.455476:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130073344 00000100:00100000:1.0:1789607507.455486:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130073344 00000100:00100000:1.0:1789607507.455572:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:1.0:1789607507.455583:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:12476:x1876539130073344:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789607507.455823:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+69:12476:x1876539130073344:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 242us (433us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789607507.455832:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:2.0:1789607507.458363:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607507.458453:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130073600 00000100:00100000:0.0:1789607507.458463:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130073600 00000100:00100000:0.0:1789607507.458513:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:0.0:1789607507.458523:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+69:12476:x1876539130073600:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789607507.458631:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+69:12476:x1876539130073600:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 109us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.458638:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:2.0:1789607507.461425:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.461496:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130073728 00000100:00100000:3.0:1789607507.461507:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130073728 00000100:00100000:3.0:1789607507.461558:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:3.0:1789607507.461567:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+69:12476:x1876539130073728:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607507.461585:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607507.461604:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe2b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b55 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.461683:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe2ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.461697:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe2ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.461707:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe2ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607507.461739:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607507.461754:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe2ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.461788:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe2b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b55 expref: 71 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.461813:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe2ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b55 expref: 70 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.461822:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:3.0:1789607507.461825:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607507.461828:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607507.461920:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+70:12476:x1876539130073728:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 343us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607507.461927:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:2.0:1789607507.464515:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.464685:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130073856 00000100:00100000:1.0:1789607507.464695:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130073856 00000100:00100000:1.0:1789607507.464754:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1789607507.464764:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130073856:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607507.464799:0:9649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607507.464820:0:9649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b5c expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607507.464846:0:9649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3e54, blocks: 0x1 00010000:00010000:1.0:1789607507.464901:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789607507.464906:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607507.464916:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 8 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.465106:0:9649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 8 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.465121:0:9649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184600, rc 0) 00000100:00100000:1.0:1789607507.465176:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130073856:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 413us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607507.465183:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:2.0:1789607507.468274:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607507.468368:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130074112 00000100:00100000:0.0:1789607507.468378:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130074112 00000100:00100000:0.0:1789607507.468440:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 192 00000100:00100000:0.0:1789607507.468451:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+70:12476:x1876539130074112:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789607507.468559:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+70:12476:x1876539130074112:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 110us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.468566:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 192 00000100:00100000:2.0:1789607507.471243:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.471338:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130074240 00000100:00100000:3.0:1789607507.471348:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130074240 00000100:00100000:3.0:1789607507.471404:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:3.0:1789607507.471430:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:12476:x1876539130074240:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607507.471448:0:8113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607507.471467:0:8113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b63 expref: -99 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.471496:0:8113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.471505:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607507.471509:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607507.471514:0:8113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 9 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.471545:0:8113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.471559:0:8113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607507.471574:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8113:1876539150060160:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607507.471655:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607507.478007:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607507.478119:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8113:1876539150060160:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607507.478151:0:8113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 9 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.478172:0:8113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:0.0:1789607507.478235:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:12476:x1876539130074240:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 6809us (7004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.478245:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607507.478908:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130074368 00000100:00100000:1.0:1789607507.478928:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130074368 00010000:00010000:1.0:1789607507.479107:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.479151:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:1.0:1789607507.479161:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130074368:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607507.479176:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607507.479200:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.479213:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.479236:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc828eed/0xa26202d240fbe2c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b5c expref: 9 pid: 9649 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.479268:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607507.479272:0:7268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607507.479280:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.479289:0:7268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.479325:0:7268:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.479340:0:7268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7268:1876539150060288:192.168.203.25@tcp:105: 00000100:00100000:1.0:1789607507.479750:0:7268:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607507.482219:0:7268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7268:1876539150060288:192.168.203.25@tcp:105: 00010000:00010000:1.0:1789607507.482245:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607507.482300:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130074368:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 3139us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607507.482310:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:2.0:1789607507.483365:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.483431:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130074496 00000100:00100000:1.0:1789607507.483440:0:8119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130074496 00002000:00100000:1.0:1789607507.483485:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d78f0700a80 x1876539130074496/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:63/0 lens 504/0 e 0 to 0 dl 1789607518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607507.483494:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78f0700a80 with x1876539130074496 ext(0->8) 00002000:00010000:1.0:1789607507.483498:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78f0700a80 00000100:00100000:1.0:1789607507.483541:0:8119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1789607507.483550:0:8119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2393:x1876539130074496:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789607507.484371:0:8119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2393:x1876539130074496:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 818us (1005us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789607507.484387:0:8119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00002000:00100000:0.0:1789607507.484396:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d78f0700a80 x1876539130074496/t4294967315(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:63/0 lens 504/448 e 0 to 0 dl 1789607518 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607507.484404:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78f0700a80 with x1876539130074496 ext(0->8) 00002000:00010000:0.0:1789607507.484409:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78f0700a80 00000100:00100000:2.0:1789607507.489332:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.489421:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130074624 00000100:00100000:1.0:1789607507.489429:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130074624 00000100:00100000:1.0:1789607507.489477:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00100000:1.0:1789607507.489484:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+70:12476:x1876539130074624:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789607507.530424:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1789607507.530446:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789607507.530464:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78c3071900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789607507.530468:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f61a0c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78c3071a80 00000020:00080000:2.0:1789607507.530472:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f61a0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7900976800 00000001:00080000:2.0:1789607507.530487:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789607507.530533:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789607507.530684:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:3.0:1789607507.530952:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.530965:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.530986:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.530993:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ea00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.530998:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531011:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531028:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d78d9b83200) 00010000:00010000:3.0:1789607507.531031:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.531036:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531043:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbdffe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531066:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531072:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531077:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531082:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.531084:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531099:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531108:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607507.531110:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.531113:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531117:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe005 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531132:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531138:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531143:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531147:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.531150:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531156:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531163:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78e28a4e00) 00010000:00010000:3.0:1789607507.531165:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.531168:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531180:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe044 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531198:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531205:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531211:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531216:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.531219:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531225:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531233:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607507.531236:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.531239:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531245:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7902053c00/0xa26202d240fbe139 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531256:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531262:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531273:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531278:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.531281:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531288:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531296:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607507.531298:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.531301:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531307:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe15c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531317:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531323:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531329:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531335:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.531338:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531352:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531360:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607507.531363:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607507.531366:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531372:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe1a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531658:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531667:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531674:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531680:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.531683:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531690:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531699:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:3.0:1789607507.531701:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789607507.531705:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.531722:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607507.531749:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150060544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789607507.531840:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607507.532028:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150060544 00000100:00100000:3.0:1789607507.532036:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150060544 00000100:00100000:3.0:1789607507.532087:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789607507.532096:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150060544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789607507.532236:0:8114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789607507.532240:0:8114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789607508 00002000:00010000:3.0:1789607507.532243:0:8114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789607507.532245:0:8114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789607508 -> 1789607508 00002000:00010000:3.0:1789607507.532248:0:8114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789607507.532285:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3470:x1876539150060544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (446us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789607507.532293:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1789607507.532331:0:3470:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78c12e8380/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789607507.532337:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150060544:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789607507.532477:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789607507.532491:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150060416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789607507.532522:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607507.532701:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12476:x1876539130074624:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 43215us (43378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607507.532709:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00080000:1.0:1789607507.533043:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607507.533401:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150060416 00000100:00100000:3.0:1789607507.533409:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150060416 00000100:00100000:3.0:1789607507.533494:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607507.533502:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150060416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789607507.533524:0:13082:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1789607507.533551:0:13082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aab3e51, atime: 0x6aab3e51, ctime: 0x6aab3e51, blocks: 0xb 00010000:00010000:3.0:1789607507.533559:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.533585:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:3.0:1789607507.533589:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607507.533596:0:13082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.533612:0:13082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.533622:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.533630:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.533645:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789607507.534200:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150060416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 697us (1675us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789607507.534208:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1789607507.534536:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607507.534545:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.534556:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607507.534561:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.534571:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.534601:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.534610:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c85cd2/0xa26202d240fbe2cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.534632:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607507.534634:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607507.534635:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607507.534664:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1789607507.534670:0:3469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967307 00000100:00100000:2.0:1789607507.534692:0:3469:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d78f0702d80 x1876539150060416/t4294967308(4294967308) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789607523 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789607507.534703:0:3469:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78f0702d80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789607507.534708:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150060416:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1789607507.535098:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607507.540261:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607507.540356:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130074752 00000100:00100000:0.0:1789607507.540367:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130074752 00000100:00100000:0.0:1789607507.540423:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:0.0:1789607507.540434:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2395:x1876539130074752:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789607507.581349:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789607507.581936:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130074752:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 41487us (41668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607507.581949:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000001:00080000:2.0:1789607507.583305:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:2.0:1789607507.589377:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607507.589753:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130075008 00000100:00100000:0.0:1789607507.589763:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130075008 00000100:00100000:1.0:1789607507.590191:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 194 00000100:00100000:1.0:1789607507.590205:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12476:x1876539130075008:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607507.590259:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607507.590285:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe2ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b55 expref: 19 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.590305:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:1.0:1789607507.590310:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607507.590342:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.590355:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.590365:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607507.590644:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000733b1f76 reply state 00000000d7affaf3 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.590657:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.590663:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:1.0:1789607507.590665:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607507.590668:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607507.591172:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:12476:x1876539130075008:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 565us (1400us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789607507.591184:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 194 00000100:00100000:0.0:1789607507.596597:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.596741:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130075136 00000100:00100000:3.0:1789607507.596752:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130075136 00000100:00100000:3.0:1789607507.596821:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607507.596832:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130075136:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789607507.597132:0:9649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789607507.597136:0:9649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789607508 -> 1789607506 00002000:00010000:3.0:1789607507.597139:0:9649:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789607505 00002000:00010000:3.0:1789607507.597141:0:9649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789607508 -> 1789607506 00002000:00010000:3.0:1789607507.597143:0:9649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789607507.597207:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130075136:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 375us (617us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789607507.597216:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607507.605187:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607507.605349:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130075392 00000100:00100000:2.0:1789607507.605359:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130075392 00000100:00100000:2.0:1789607507.605414:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:2.0:1789607507.605424:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:12476:x1876539130075392:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789607507.605489:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.605508:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 20 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.605531:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.605565:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 20 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.605578:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 20 pid: 12196 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607507.605594:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150060672:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607507.605677:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607507.613652:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150060672:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607507.613684:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607507.613814:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.614577:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130075520 00000100:00100000:3.0:1789607507.614587:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130075520 00010000:00010000:3.0:1789607507.614624:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 21 pid: 12196 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607507.614667:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:3.0:1789607507.614677:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:2395:x1876539130075520:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607507.614690:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607507.614697:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 21 pid: 12196 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.614709:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 21 pid: 12196 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.614731:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe29e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b47 expref: 21 pid: 12196 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.614832:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:3.0:1789607507.614838:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.614848:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.614857:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.615348:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607507.615414:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:2395:x1876539130075520:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 737us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607507.615423:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 87 00010000:00010000:3.0:1789607507.615485:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615493:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615524:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615531:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615538:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615545:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.615549:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615556:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615574:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:3.0:1789607507.615577:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789607507.615581:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.615587:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe2dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607507.615630:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12476:x1876539130075392:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 10207us (10453us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789607507.615638:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:0.0:1789607507.618166:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607507.619159:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130075648 00000100:00100000:2.0:1789607507.619170:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130075648 00000100:00100000:2.0:1789607507.619225:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:2.0:1789607507.619237:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130075648:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789607507.619281:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.619300:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.619324:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607507.619328:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607507.619333:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.619367:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.619381:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 8 pid: 8113 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607507.619395:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8112:1876539150060800:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607507.619477:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9180 going to sleep for 11 seconds 00000040:00080000:1.0:1789607507.620770:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607507.626887:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8112:1876539150060800:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607507.626928:0:8112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607507.633445:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.633586:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130075776 00000100:00100000:1.0:1789607507.633595:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130075776 00010000:00010000:1.0:1789607507.633635:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 9 pid: 8113 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.633679:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:1.0:1789607507.633689:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130075776:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607507.633704:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607507.633728:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 9 pid: 8113 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.633742:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 9 pid: 8113 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.633806:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe2c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b63 expref: 9 pid: 8113 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.633824:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607507.633828:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607507.633833:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.633842:0:6454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.634148:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607507.634317:0:8112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634329:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634356:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634364:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634372:0:8112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634379:0:8112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607507.634390:0:8112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634399:0:8112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634412:0:8112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.634419:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d0bcd9e/0xa26202d240fbe2e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.634485:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130075776:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 795us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607507.634493:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:3.0:1789607507.637477:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130075648:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 18230us (19306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607507.637492:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:1.0:1789607507.652725:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607507.652947:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130076032 00000100:00100000:3.0:1789607507.652957:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130076032 00000100:00100000:3.0:1789607507.653016:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 196 00000100:00100000:3.0:1789607507.653027:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12476:x1876539130076032:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607507.653115:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653133:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653144:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653355:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653367:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 20 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653377:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653410:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 20 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.653424:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 20 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607507.653438:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150060928:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607507.653518:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607507.657341:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150060928:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607507.657372:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607507.657443:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.657656:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130076160 00000100:00100000:1.0:1789607507.657664:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130076160 00010000:00010000:1.0:1789607507.657700:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 21 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.657740:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 89 00000100:00100000:1.0:1789607507.657751:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:2395:x1876539130076160:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607507.657766:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607507.657773:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 21 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.657808:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 21 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.657830:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe2ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b4e expref: 21 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.657845:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:1.0:1789607507.657850:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.657859:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.657893:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.657926:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607507.657983:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:2395:x1876539130076160:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 234us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607507.657991:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 89 00010000:00010000:3.0:1789607507.659733:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.659748:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607507.660464:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789607507.660632:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789607507.660677:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789607507.660762:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150061056:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789607507.660841:0:6468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607507.660887:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607507.660972:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150061056 00000100:00100000:0.0:1789607507.660981:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150061056 00000100:00100000:0.0:1789607507.661031:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789607507.661041:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6468:x1876539150061056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789607507.661127:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6468:x1876539150061056:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.661144:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789607507.661916:0:6468:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789607507.661925:0:6468:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78c12e8380, transno 4294967316 00000100:00100000:2.0:1789607507.661940:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150061056:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789607507.662427:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789607507.662518:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150061184:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789607507.662576:0:6468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607507.662612:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607507.665070:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150061184 00000100:00100000:1.0:1789607507.665085:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150061184 00000100:00100000:1.0:1789607507.665190:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789607507.665199:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6468:x1876539150061184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789607507.665443:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6468:x1876539150061184:12345-0@lo:1000:mdt00_000.0 Request processed in 244us (2866us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789607507.665450:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789607507.668477:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150061184:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789607507.668529:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668823:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668831:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668838:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.668842:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668850:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668887:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:3.0:1789607507.668890:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607507.668896:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668903:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe2f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.668929:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.669298:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.669304:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.669310:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607507.669313:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.669320:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.669330:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607507.669332:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607507.669336:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607507.669342:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe227 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.669430:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.669446:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 23 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.669455:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.669493:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 23 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.669507:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 23 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607507.669522:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150061312:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607507.669617:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607507.674848:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150061312:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607507.674896:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607507.676255:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.677840:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130076288 00000100:00100000:1.0:1789607507.677854:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130076288 00010000:00010000:1.0:1789607507.677944:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 24 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.677990:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:1.0:1789607507.678000:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:2395:x1876539130076288:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607507.678015:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607507.678023:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 24 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.678036:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 24 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.678058:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe243 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b32 expref: 24 pid: 6470 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.678074:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:1.0:1789607507.678079:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.678089:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.678097:0:7268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.678129:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607507.678164:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678173:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607507.678183:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:2395:x1876539130076288:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 185us (1935us total) trans 0 rc 0/0 00010000:00010000:2.0:1789607507.678185:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678191:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678197:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678203:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc22224f0) 00000100:00100000:1.0:1789607507.678206:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 90 00010000:00010000:2.0:1789607507.678207:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678214:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678222:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607507.678225:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607507.678228:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678234:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe2f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678243:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678255:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678260:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678265:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607507.678268:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678274:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678283:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607507.678285:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607507.678288:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607507.678294:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe2eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607507.678537:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:12476:x1876539130076032:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 25510us (25820us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789607507.678546:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 196 00000020:00080000:2.0:1789607507.678550:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789607507.682386:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607507.682395:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607507.682914:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789607507.682924:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607507.683037:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78faae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150061440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607507.683098:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607507.690396:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150061440 00000100:00100000:0.0:1789607507.690406:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150061440 00000100:00100000:0.0:1789607507.690472:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789607507.690483:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150061440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607507.690519:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607507.690608:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150061440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (7510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.690616:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789607507.690643:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150061568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607507.690678:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607507.690720:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607507.690732:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150061568 00000100:00100000:0.0:1789607507.690736:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150061568 00000100:00100000:0.0:1789607507.690757:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607507.690764:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150061568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607507.690798:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607507.690829:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150061568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607507.690834:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607507.690899:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78faae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150061440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607507.691313:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150061568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607507.691993:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607507.694093:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130076544 00000100:00100000:1.0:1789607507.694107:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130076544 00000100:00100000:1.0:1789607507.694172:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:1.0:1789607507.694182:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0070850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:12476:x1876539130076544:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789607507.694836:0:6471:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789607507.694955:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789607507.695000:0:6471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.695018:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.695029:0:6471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.695037:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.695044:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.695050:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607507.695076:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607507.695169:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0070850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:12476:x1876539130076544:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 985us (3176us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789607507.695184:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000020:00080000:1.0:1789607507.695189:0:6471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789607507.695756:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607507.695764:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.695777:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607507.695781:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.695797:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.695825:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:0.0:1789607507.695828:0:6457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789607507.695834:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.695840:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185600/0xa26202d240fbe300 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607507.695854:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607507.695855:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607507.695857:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607508.194184:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607508.194211:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150061696:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789607508.194215:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607508.194285:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607508.194382:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150061696 00000100:00100000:0.0:1789607508.194390:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150061696 00000100:00100000:0.0:1789607508.194443:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789607508.194453:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9c78450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150061696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607508.194490:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1789607508.194550:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9c78450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150061696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607508.194556:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789607508.194609:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150061696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607508.706157:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607508.706181:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150061824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607508.706251:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607508.706373:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150061824 00000100:00100000:3.0:1789607508.706382:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150061824 00000100:00100000:3.0:1789607508.706433:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789607508.706442:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150061824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607508.706481:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607508.706535:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150061824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607508.706551:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789607508.706760:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150061824:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789607509.166036:0:14258:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607509.166045:0:14258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607509.166081:0:14258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789607509.166089:0:14258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789607509.219360:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607509.284858:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.286064:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130076800 00000100:00100000:0.0:1789607509.286077:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130076800 00000100:00100000:0.0:1789607509.286142:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:0.0:1789607509.286153:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+24:12493:x1876539130076800:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607509.286176:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607509.286204:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b6a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.286295:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe30e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.286309:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe30e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.286321:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe30e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607509.286331:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789607509.286444:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b6a expref: 27 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.286461:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe30e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b6a expref: 26 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.286469:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607509.286472:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789607509.286475:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9c00, rc 0) 00000100:00100000:0.0:1789607509.286531:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12493:x1876539130076800:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 380us (1682us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789607509.286539:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00080000:0.0:1789607509.286560:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607509.290356:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.290830:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130076928 00000100:00100000:3.0:1789607509.290840:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130076928 00000100:00100000:3.0:1789607509.291089:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 198 00000100:00100000:3.0:1789607509.291099:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12493:x1876539130076928:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:3.0:1789607509.291187:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.291204:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.291217:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.291232:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.291244:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.292093:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.293629:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294048:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294060:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607509.294110:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294150:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294158:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294166:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294172:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.294177:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294184:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294198:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607509.294201:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607509.294205:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294212:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe31c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294225:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294231:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294237:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294259:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.294263:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294270:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294279:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c13dd400) 00010000:00010000:3.0:1789607509.294281:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607509.294284:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294290:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe323 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294305:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294312:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294317:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294322:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ea00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.294325:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294331:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294348:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c13ddd00) 00010000:00010000:3.0:1789607509.294350:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607509.294354:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.294360:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe32a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.294454:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12493:x1876539130076928:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 3353us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607509.294463:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 198 00000100:00100000:1.0:1789607509.342564:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.342763:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130077184 00000100:00100000:2.0:1789607509.342772:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130077184 00000100:00100000:2.0:1789607509.342834:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00100000:2.0:1789607509.342844:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12496:x1876539130077184:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607509.342888:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607509.342908:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe331 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b71 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343093:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343108:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343120:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343136:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343144:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343166:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343426:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343436:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343444:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607509.343454:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789607509.343568:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343576:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343583:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343588:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.343593:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343600:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343611:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607509.343615:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.343628:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343636:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe338 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.343646:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344089:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344096:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344102:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.344105:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344112:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344122:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:2.0:1789607509.344124:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.344127:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344133:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe33f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344183:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe331 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 29 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344213:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 28 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.344222:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607509.344224:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607509.344226:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581800, rc 0) 00000100:00100000:2.0:1789607509.344333:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12496:x1876539130077184:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1489us (1776us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789607509.344341:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00100000:2.0:1789607509.355198:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.355285:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130077312 00000100:00100000:3.0:1789607509.355295:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130077312 00000100:00100000:3.0:1789607509.355354:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 200 00000100:00100000:3.0:1789607509.355365:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12496:x1876539130077312:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1789607509.355430:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355446:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355457:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355482:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355602:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355621:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355627:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ea00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.355631:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355640:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355661:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:3.0:1789607509.355664:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607509.355669:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.355675:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.355744:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12496:x1876539130077312:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 381us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607509.355751:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 200 00000100:00100000:1.0:1789607509.358766:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.358854:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130077568 00000100:00100000:2.0:1789607509.358889:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130077568 00000100:00100000:2.0:1789607509.359076:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:1.0:1789607509.359083:0:6471:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789607509.359090:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12496:x1876539130077568:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607509.359094:0:6471:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789607509.359323:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:12496:x1876539130077568:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 237us (566us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789607509.359331:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:1.0:1789607509.402624:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.402742:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130077824 00000100:00100000:3.0:1789607509.402752:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130077824 00000100:00100000:3.0:1789607509.402832:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 201 00000100:00100000:3.0:1789607509.402843:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:12021:x1876539130077824:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1789607509.402895:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607509.402938:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe35b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b78 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.403279:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.403293:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 30 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.403301:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.403331:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 30 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.403347:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 30 pid: 6468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.403362:0:12196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150061952:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607509.403456:0:12196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0938b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607509.407058:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.407161:0:12196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1876539150061952:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607509.407187:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.407291:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130077952 00000100:00100000:0.0:1789607509.407299:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130077952 00010000:00010000:0.0:1789607509.407335:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 31 pid: 6468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.407395:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:0.0:1789607509.407404:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:2395:x1876539130077952:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607509.407418:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607509.407425:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 31 pid: 6468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.407437:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 31 pid: 6468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.407458:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe346 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b71 expref: 31 pid: 6468 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.407473:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:0.0:1789607509.407478:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.407510:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.407519:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.407545:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607509.407581:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.407590:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.407592:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:2395:x1876539130077952:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 188us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607509.407607:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000004:00200000:3.0:1789607509.407620:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789607509.407795:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe35b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 31 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.407813:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 30 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.407821:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:3.0:1789607509.407824:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607509.407826:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571fc00, rc 0) 00000100:00100000:3.0:1789607509.407889:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:12021:x1876539130077824:12345-192.168.203.25@tcp:101:bash.0 Request processed in 5047us (5273us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789607509.407897:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 201 00000100:00100000:2.0:1789607509.413287:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.413494:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130078208 00000100:00100000:0.0:1789607509.413514:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130078208 00000100:00100000:0.0:1789607509.413573:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 202 00000100:00100000:0.0:1789607509.413583:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:12021:x1876539130078208:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:0.0:1789607509.413990:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.414007:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.414018:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607509.414063:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789607509.414083:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003364937 reply state 0000000015135068 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.414093:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.414100:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:0.0:1789607509.414103:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789607509.414107:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789607509.414145:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789607509.414302:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:12021:x1876539130078208:12345-192.168.203.25@tcp:36:bash.0 Request processed in 719us (1023us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789607509.414309:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 202 00000020:00080000:0.0:1789607509.414314:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789607509.419545:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.419627:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130078336 00000100:00100000:3.0:1789607509.419636:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130078336 00000100:00100000:3.0:1789607509.419696:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 203 00000100:00100000:3.0:1789607509.419706:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+34:12021:x1876539130078336:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1789607509.419729:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607509.419749:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe377 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b7f expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.419814:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe377 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b7f expref: 35 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.419829:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe377 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b7f expref: 35 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.419849:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:3.0:1789607509.419899:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607509.419904:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ea00, rc 0) 00000100:00100000:3.0:1789607509.419970:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:12021:x1876539130078336:12345-192.168.203.25@tcp:101:bash.0 Request processed in 265us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607509.419977:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 203 00000100:00100000:1.0:1789607509.422755:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.423032:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130078464 00000100:00100000:3.0:1789607509.423041:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130078464 00000100:00100000:3.0:1789607509.423153:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:3.0:1789607509.423164:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:12021:x1876539130078464:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1789607509.423182:0:8113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607509.423213:0:8113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b86 expref: -99 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607509.423239:0:8113:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aab3e52, atime: 0x6aab3e51, ctime: 0x6aab3e52, blocks: 0xb 00010000:00010000:3.0:1789607509.423260:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789607509.423265:0:8113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607509.423273:0:8113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.423288:0:8113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 8 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.423300:0:8113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f800, rc 0) 00000100:00100000:3.0:1789607509.423354:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:12021:x1876539130078464:12345-192.168.203.25@tcp:101:bash.0 Request processed in 193us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607509.423362:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00080000:0.0:1789607509.429091:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607509.438675:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607509.438889:0:8118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130078592 00000100:00100000:1.0:1789607509.438899:0:8118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130078592 00002000:00010000:1.0:1789607509.438948:0:8118:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1789607509.438961:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d77c4410700 with x1876539130078592 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607509.438974:0:8118:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d77c4410700. 00000100:00100000:1.0:1789607509.439004:0:8118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1789607509.439014:0:8118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130078592:12345-192.168.203.25@tcp:10:bash.0 00002000:00010000:1.0:1789607509.439273:0:8118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789607509.439277:0:8118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789607506 -> 1789607510 00002000:00010000:1.0:1789607509.439280:0:8118:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789607505 -> 1789607505 00002000:00010000:1.0:1789607509.439282:0:8118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789607506 -> 1789607510 00002000:00010000:1.0:1789607509.439284:0:8118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789607509.439349:0:8118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130078592:12345-192.168.203.25@tcp:10:bash.0 Request processed in 335us (683us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789607509.439375:0:8118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00002000:00010000:1.0:1789607509.439379:0:8118:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1789607509.439381:0:8118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d77c4410700 with x1876539130078592 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607509.439386:0:8118:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d77c4410700. 00000100:00100000:2.0:1789607509.499598:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.499682:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130078720 00000100:00100000:3.0:1789607509.499691:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130078720 00000100:00100000:3.0:1789607509.499748:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 204 00000100:00100000:3.0:1789607509.499766:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:12510:x1876539130078720:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:3.0:1789607509.499843:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.499895:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.499908:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.499932:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.499938:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.499945:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500203:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500213:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500220:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607509.500261:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500283:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500289:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500296:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500302:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.500306:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500314:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500326:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607509.500329:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607509.500333:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500339:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe385 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500350:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500356:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500361:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500372:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.500375:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500381:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500389:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c13dd300) 00010000:00010000:3.0:1789607509.500391:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607509.500394:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500400:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe38c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500414:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500420:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500425:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500429:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ec00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.500432:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500437:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500455:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:3.0:1789607509.500458:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607509.500461:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.500466:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe393 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.500546:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:12510:x1876539130078720:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 789us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607509.500554:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 204 00000100:00100000:0.0:1789607509.544381:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.544541:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130078976 00000100:00100000:2.0:1789607509.544552:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130078976 00000100:00100000:2.0:1789607509.544664:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 205 00000100:00100000:2.0:1789607509.544675:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+35:12514:x1876539130078976:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607509.544709:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607509.544729:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe39a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b8d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.544809:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.544824:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.544836:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.544851:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.544892:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.544902:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545233:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe3af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545244:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe3af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545252:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe3af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607509.545263:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789607509.545367:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545375:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545383:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545390:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.545394:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545403:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545415:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607509.545418:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.545423:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545429:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545441:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545447:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545453:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545457:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.545467:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545487:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545497:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:2.0:1789607509.545499:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.545502:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545507:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545550:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe39a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b8d expref: 38 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545564:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe3af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b8d expref: 37 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.545572:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607509.545574:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789607509.545576:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580000, rc 0) 00000100:00100000:2.0:1789607509.545641:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12514:x1876539130078976:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 967us (1271us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789607509.545649:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 205 00000100:00100000:1.0:1789607509.550269:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.550385:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130079104 00000100:00100000:0.0:1789607509.550410:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130079104 00000100:00100000:0.0:1789607509.550477:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 206 00000100:00100000:0.0:1789607509.550489:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12514:x1876539130079104:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607509.550556:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.550573:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 37 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.550583:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.550619:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 37 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.550633:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 37 pid: 12196 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.550648:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150062080:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607509.550732:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607509.554413:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.554502:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130079360 00000100:00100000:3.0:1789607509.554512:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130079360 00000100:00100000:3.0:1789607509.554568:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1789607509.554578:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:6371:x1876539130079360:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789607509.554928:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+39:6371:x1876539130079360:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 350us (523us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789607509.554935:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607509.558363:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150062080:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607509.558391:0:6469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607509.561749:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.562047:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130079488 00000100:00100000:2.0:1789607509.562057:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130079488 00010000:00010000:2.0:1789607509.562097:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 39 pid: 12196 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607509.562250:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:2.0:1789607509.562260:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+39:2396:x1876539130079488:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607509.562276:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607509.562283:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 39 pid: 12196 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.562297:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 39 pid: 12196 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.562318:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbe362 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b78 expref: 39 pid: 12196 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.562335:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607509.562340:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.562349:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.562357:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.562391:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607509.562447:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:2396:x1876539130079488:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 189us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607509.562454:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00010000:00010000:0.0:1789607509.563067:0:6469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563078:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563112:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563119:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563146:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563152:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607509.563156:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563164:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563174:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:0.0:1789607509.563177:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607509.563181:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.563186:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe3bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.563245:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12514:x1876539130079104:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 12757us (12985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607509.563253:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 206 00000100:00100000:1.0:1789607509.566737:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.567091:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130079744 00000100:00100000:3.0:1789607509.567102:0:14272:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130079744 00000100:00100000:3.0:1789607509.567160:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:3.0:1789607509.567171:0:14272:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+37:12514:x1876539130079744:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607509.567404:0:14272:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:12514:x1876539130079744:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 234us (676us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789607509.567412:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:3.0:1789607509.661592:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.661713:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130080000 00000100:00100000:2.0:1789607509.661729:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130080000 00000100:00100000:2.0:1789607509.661802:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:2.0:1789607509.661813:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+38:12525:x1876539130080000:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:2.0:1789607509.661838:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607509.661858:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b94 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.661980:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.661995:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662006:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662020:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662027:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662034:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662284:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe3d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662294:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662302:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607509.662317:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789607509.662406:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662414:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662420:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662427:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.662432:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662441:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662453:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607509.662456:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.662461:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662468:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662688:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662693:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662710:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662715:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.662718:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662725:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662733:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:2.0:1789607509.662736:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.662740:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662746:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662800:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b94 expref: 41 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662814:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b94 expref: 40 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.662821:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607509.662824:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607509.662826:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607509.663324:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12525:x1876539130080000:12345-192.168.203.25@tcp:101:cat.0 Request processed in 1510us (1740us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789607509.663342:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:2.0:1789607509.669145:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607509.669315:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130080256 00000100:00100000:1.0:1789607509.669325:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130080256 00000100:00100000:1.0:1789607509.669374:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1789607509.669383:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12525:x1876539130080256:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:1.0:1789607509.669625:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:12525:x1876539130080256:12345-192.168.203.25@tcp:35:cat.0 Request processed in 242us (488us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789607509.673043:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1789607509.685268:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.687292:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130080512 00000100:00100000:2.0:1789607509.687307:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130080512 00000100:00100000:2.0:1789607509.687374:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 208 00000100:00100000:2.0:1789607509.687383:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+41:12526:x1876539130080512:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:2.0:1789607509.687434:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789607509.687457:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe3d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b94 expref: 41 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687489:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe3af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b8d expref: 40 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687501:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ea00/0xa26202d240fbe377 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b7f expref: 39 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687511:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607509.687515:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607509.687534:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687545:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687554:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687564:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687582:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687588:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687806:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687816:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.687823:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607509.688515:0:6468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789607509.688524:0:6468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414645661656ns, next at 415645659432ns, rc = 0 00010000:00010000:2.0:1789607509.688577:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688586:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688593:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688600:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688606:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688621:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688647:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607509.688666:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688672:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688678:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688683:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.688687:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688693:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688701:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:2.0:1789607509.688704:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789607509.688707:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688712:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe3f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688725:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688731:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688740:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688745:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607509.688747:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688752:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688759:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607509.688761:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607509.688764:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688769:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe3e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607509.688790:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daa82072 reply state 0000000037476e9e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688800:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.688806:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:2.0:1789607509.688808:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607509.688811:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607509.688889:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607509.688896:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.688902:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607509.688905:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607509.688908:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12526:x1876539130080512:12345-192.168.203.25@tcp:36:rm.0 Request processed in 1523us (3648us total) trans 4294967483 rc 0/0 00010000:00010000:1.0:1789607509.688940:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.688949:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:1.0:1789607509.688951:0:6457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789607509.688954:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.688961:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe3fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.688971:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607509.688972:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607509.688974:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607509.690661:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 208 00000100:00100000:3.0:1789607509.723517:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.723615:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130080768 00000100:00100000:0.0:1789607509.723624:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130080768 00000100:00100000:0.0:1789607509.723718:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:0.0:1789607509.723729:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+40:12532:x1876539130080768:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607509.723753:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607509.723798:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe403 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668b9b expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.724087:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.724102:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.724112:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.724122:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.724129:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.724135:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607509.724647:0:6469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789607509.725108:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725119:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725129:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725160:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725178:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725184:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725190:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607509.725194:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725201:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725212:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607509.725215:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607509.725219:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725225:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbe40a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607509.725238:0:6469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a536df58 reply state 000000000cd119eb transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725249:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725254:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:0.0:1789607509.725256:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789607509.725259:0:6469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789607509.725294:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe403 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 43 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725317:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 42 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.725323:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607509.725326:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607509.725328:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8800, rc 0) 00000100:00100000:0.0:1789607509.725397:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12532:x1876539130080768:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1669us (1889us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789607509.725406:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:3.0:1789607509.731626:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.732121:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130080896 00000100:00100000:0.0:1789607509.732132:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130080896 00000100:00100000:0.0:1789607509.732254:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:0.0:1789607509.732264:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2394:x1876539130080896:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607509.732280:0:13082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607509.732298:0:13082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ba2 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607509.732323:0:13082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607509.732345:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1789607509.732349:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607509.732358:0:13082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 6 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.732375:0:13082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 6 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.732410:0:13082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8a00, rc 0) 00000100:00100000:0.0:1789607509.732477:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2394:x1876539130080896:12345-192.168.203.25@tcp:101:bash.0 Request processed in 214us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607509.732485:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00080000:2.0:1789607509.736324:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607509.738657:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.738754:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130081024 00000100:00100000:0.0:1789607509.738781:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130081024 00000100:00100000:0.0:1789607509.738847:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:0.0:1789607509.738858:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:12532:x1876539130081024:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607509.738908:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607509.739170:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ba9 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.739208:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 7 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.739218:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607509.739223:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607509.739230:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.739263:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 7 pid: 13082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.739277:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 7 pid: 13082 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.739308:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150062208:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607509.739414:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607509.744403:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.744947:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130081152 00000100:00100000:3.0:1789607509.744956:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130081152 00010000:00010000:3.0:1789607509.745000:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 8 pid: 13082 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.745045:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:3.0:1789607509.745054:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130081152:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607509.745068:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607509.745091:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 8 pid: 13082 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.745103:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 8 pid: 13082 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.745127:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607509.745131:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607509.745139:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.745149:0:6456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.745184:0:6456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.745218:0:6456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150062336:192.168.203.25@tcp:105: 00000100:00100000:3.0:1789607509.745289:0:6456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31e40 going to sleep for 11 seconds 00010000:00010000:0.0:1789607509.745958:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010818f0a/0xa26202d240fbe426 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba2 expref: 8 pid: 13082 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607509.745974:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c5f19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8112:1876539150062208:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607509.745996:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.746007:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:0.0:1789607509.746048:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:12532:x1876539130081024:12345-192.168.203.25@tcp:101:bash.0 Request processed in 7192us (7400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607509.746056:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1789607509.751204:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.751277:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130081408 00000100:00100000:0.0:1789607509.751287:0:14272:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130081408 00000100:00100000:0.0:1789607509.751347:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:0.0:1789607509.751356:0:14272:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+43:12532:x1876539130081408:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:0.0:1789607509.751709:0:14272:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:12532:x1876539130081408:12345-192.168.203.25@tcp:35:bash.0 Request processed in 352us (514us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789607509.751716:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1789607509.754353:0:6456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6456:1876539150062336:192.168.203.25@tcp:105: 00010000:00010000:3.0:1789607509.754380:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607509.754451:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130081152:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 9397us (10057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607509.754463:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:1.0:1789607509.927638:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.927743:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130081536 00000100:00100000:2.0:1789607509.927753:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130081536 00000100:00100000:2.0:1789607509.927830:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 210 00000100:00100000:2.0:1789607509.927840:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+44:12548:x1876539130081536:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607509.927887:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607509.927909:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bb0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.928169:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe43b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.928183:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe43b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.928193:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe43b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607509.928223:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789607509.928226:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607509.928242:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe43b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.928263:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bb0 expref: 46 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.928279:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe43b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bb0 expref: 45 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.928287:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607509.928302:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607509.928305:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580000, rc 0) 00000100:00100000:2.0:1789607509.928360:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+45:12548:x1876539130081536:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 522us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607509.928367:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 210 00000100:00100000:2.0:1789607509.932022:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.932269:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130081792 00000100:00100000:3.0:1789607509.932280:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130081792 00000100:00100000:3.0:1789607509.932340:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 211 00000100:00100000:3.0:1789607509.932351:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+45:12548:x1876539130081792:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607509.932373:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607509.932393:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bb7 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.932487:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe449 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.932502:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.932514:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607509.932525:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789607509.932648:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bb7 expref: 48 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.932681:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bb7 expref: 47 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.932689:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:3.0:1789607509.932692:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607509.932695:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ec00, rc 0) 00000100:00100000:3.0:1789607509.932830:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:12548:x1876539130081792:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 479us (816us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789607509.932838:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 211 00000100:00100000:1.0:1789607509.936837:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607509.936924:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607509.937139:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082176 00000100:00100000:2.0:1789607509.937150:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082176 00000100:00100000:2.0:1789607509.937220:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1789607509.937231:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+47:2393:x1876539130082176:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607509.937247:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607509.937271:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe449 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bb7 expref: 47 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.937290:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:2.0:1789607509.937295:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607509.937348:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:2393:x1876539130082176:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 120us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607509.937356:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:0.0:1789607509.938341:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082048 00000100:00100000:0.0:1789607509.938349:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082048 00000100:00100000:0.0:1789607509.938389:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 212 00000100:00100000:0.0:1789607509.938412:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+46:12548:x1876539130082048:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607509.938434:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607509.938452:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe457 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bbe expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.938544:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe45e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.938557:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe45e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.938569:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe45e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607509.938579:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789607509.938702:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbe457 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bbe expref: 49 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.938718:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe45e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bbe expref: 48 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.938725:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607509.938728:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607509.938731:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8200, rc 0) 00000100:00100000:0.0:1789607509.938801:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+48:12548:x1876539130082048:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 391us (1973us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789607509.938809:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 212 00000100:00100000:1.0:1789607509.949651:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607509.949743:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082304 00000100:00100000:3.0:1789607509.949761:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082304 00000100:00100000:3.0:1789607509.949827:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:3.0:1789607509.949839:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+6:2396:x1876539130082304:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:3.0:1789607509.949915:0:9649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.949944:0:9649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.950128:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607509.950132:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607509.950137:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.950174:0:9649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.950201:0:9649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 6 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607509.950216:0:9649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9649:1876539150062464:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607509.950308:0:9649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607509.955174:0:9649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9649:1876539150062464:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607509.955206:0:9649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607509.958397:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607509.958499:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082432 00000100:00100000:0.0:1789607509.958509:0:8119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082432 00002000:00100000:0.0:1789607509.958573:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d7900efe300 x1876539130082432/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:65/0 lens 504/0 e 0 to 0 dl 1789607520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607509.958585:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7900efe300 with x1876539130082432 ext(0->8) 00010000:00010000:0.0:1789607509.958594:0:8119:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 7 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.958625:0:8119:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 7 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607509.958634:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d7900efe300 00000100:00100000:0.0:1789607509.958663:0:8119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607509.958681:0:8119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2395:x1876539130082432:12345-192.168.203.25@tcp:4:lfs.0 00000100:00100000:0.0:1789607509.959808:0:8119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2395:x1876539130082432:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 1121us (1413us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789607509.959820:0:8119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00002000:00100000:0.0:1789607509.959830:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d7900efe300 x1876539130082432/t4294967309(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:65/0 lens 504/448 e 0 to 0 dl 1789607520 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607509.959840:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7900efe300 with x1876539130082432 ext(0->8) 00010000:00010000:0.0:1789607509.959849:0:8119:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 9 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607509.959888:0:8119:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 9 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607509.959897:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d7900efe300 00000100:00100000:2.0:1789607509.965421:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607509.969885:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082560 00000100:00100000:1.0:1789607509.969900:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082560 00010000:00010000:1.0:1789607509.970127:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 9 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607509.970178:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:1.0:1789607509.970187:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130082560:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607509.970218:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789607509.970236:0:6455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789607509.970239:0:6455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789607510 00002000:00010000:1.0:1789607509.970241:0:6455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789607510 00002000:00010000:1.0:1789607509.970243:0:6455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789607510 00010000:00010000:1.0:1789607509.970249:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 9 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.970261:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 9 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.970285:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe42d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ba9 expref: 9 pid: 8112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.970300:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607509.970304:0:6455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607509.970310:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.970319:0:6455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.970856:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607509.970992:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130082560:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 800us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607509.971001:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 94 00010000:00010000:2.0:1789607509.971023:0:9649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971038:0:9649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971064:0:9649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971080:0:9649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971088:0:9649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971097:0:9649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607509.971101:0:9649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971115:0:9649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971129:0:9649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607509.971137:0:9649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90ea367/0xa26202d240fbe46c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607509.971192:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130082304:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 21356us (21551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607509.971200:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:2.0:1789607509.977017:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607509.977091:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082816 00000100:00100000:1.0:1789607509.977100:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082816 00000100:00100000:1.0:1789607509.977164:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607509.977174:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0071050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+48:12548:x1876539130082816:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:1.0:1789607509.977230:0:6471:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe45e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bbe expref: 48 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607509.977447:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789607509.977492:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789607509.977759:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789607509.977822:0:6471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.977838:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 52 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.977845:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.977908:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 52 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.977921:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 52 pid: 6469 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607509.977935:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6471:1876539150062592:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607509.978096:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607509.987638:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6471:1876539150062592:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607509.987694:0:6471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607509.990713:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607509.994900:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130082944 00000100:00100000:1.0:1789607509.994917:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130082944 00010000:00010000:1.0:1789607509.994969:0:7268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 53 pid: 6469 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607509.995076:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:1.0:1789607509.995087:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+53:2396:x1876539130082944:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607509.995102:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607509.995109:0:7268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 53 pid: 6469 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.995121:0:7268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 53 pid: 6469 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.995142:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe418 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b9b expref: 53 pid: 6469 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.995158:0:7268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607509.995164:0:7268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.995173:0:7268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.995181:0:7268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607509.995227:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607509.995267:0:6471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.995279:0:6471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607509.995302:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+52:2396:x1876539130082944:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 216us (4597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607509.995311:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 95 00000001:00080000:3.0:1789607509.995415:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1789607509.995817:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789607509.996084:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150062720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789607509.996137:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607509.996168:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0938b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607509.996897:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150062720 00000100:00100000:0.0:1789607509.996908:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150062720 00000100:00100000:0.0:1789607509.996965:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789607509.996974:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6471:x1876539150062720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1789607509.997018:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607509.997079:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6471:x1876539150062720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607509.997086:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789607509.997537:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78facc4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150062720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789607509.998076:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789607509.998154:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c12ebb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150062848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789607509.998197:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607509.998241:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607509.998378:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150062848 00000100:00100000:0.0:1789607509.998385:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150062848 00000100:00100000:0.0:1789607509.998434:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789607509.998444:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c12e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6471:x1876539150062848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789607509.998604:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c12e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6471:x1876539150062848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 161us (405us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789607509.998612:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789607509.999197:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c12ebb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6471:1876539150062848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789607509.999258:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789607509.999301:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.999311:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.999319:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.999325:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607509.999330:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.999337:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.999353:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:3.0:1789607509.999357:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789607509.999362:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607509.999368:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbe473 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607510.003277:0:6471:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789607510.003398:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789607510.003411:0:6471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414960548884ns, next at 415960545562ns, rc = 0 00000001:00080000:3.0:1789607510.003420:0:6471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789607510.003487:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:3.0:1789607510.003492:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789607510.003502:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe45e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bbe expref: 56 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.003624:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0071050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:12548:x1876539130082816:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 26450us (26614us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789607510.003633:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000020:00080000:3.0:1789607510.003639:0:6471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789607510.016252:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.016370:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130083072 00000100:00100000:0.0:1789607510.016380:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130083072 00000100:00100000:0.0:1789607510.016448:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 213 00000100:00100000:0.0:1789607510.016459:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+55:12548:x1876539130083072:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607510.016493:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607510.016515:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe47a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bc5 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.016575:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe47a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bc5 expref: 56 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.016590:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe47a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bc5 expref: 56 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.016623:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607510.016627:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607510.016631:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:0.0:1789607510.016692:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:12548:x1876539130083072:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 234us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.016699:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 213 00000100:00100000:2.0:1789607510.024764:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.025300:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130083328 00000100:00100000:3.0:1789607510.025311:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130083328 00000100:00100000:3.0:1789607510.025369:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607510.025379:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+56:12548:x1876539130083328:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607510.025596:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:12548:x1876539130083328:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 217us (841us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789607510.025604:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607510.133978:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.134107:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130083456 00000100:00100000:0.0:1789607510.134117:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130083456 00000100:00100000:0.0:1789607510.134178:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 214 00000100:00100000:0.0:1789607510.134189:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:12558:x1876539130083456:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1789607510.134265:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134283:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134295:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134307:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134314:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134320:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134412:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134436:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134444:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607510.134499:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134512:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134519:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134526:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134532:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607510.134535:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134542:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134552:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607510.134555:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607510.134559:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134564:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe481 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134584:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134590:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134595:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134600:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607510.134603:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134609:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134617:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:0.0:1789607510.134620:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607510.134623:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134628:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134637:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134643:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134648:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134659:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607510.134661:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134668:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134676:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607510.134678:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607510.134681:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.134687:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe48f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607510.134767:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78faae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:12558:x1876539130083456:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 579us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.134784:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 214 00000100:00100000:2.0:1789607510.228587:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.228963:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130083712 00000100:00100000:1.0:1789607510.228973:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130083712 00000100:00100000:1.0:1789607510.229038:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 215 00000100:00100000:1.0:1789607510.229049:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+57:12561:x1876539130083712:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607510.229069:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607510.229091:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe496 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bcc expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229415:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229431:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229442:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229455:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229461:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229468:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229612:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe4ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229621:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.229629:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607510.229638:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789607510.230188:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230198:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230205:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230210:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.230214:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230222:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230234:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:1.0:1789607510.230237:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607510.230241:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230259:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe49d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230274:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230280:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230285:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230290:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.230293:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230298:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230306:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:1.0:1789607510.230309:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607510.230312:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230317:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230359:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbe496 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bcc expref: 60 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230389:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bcc expref: 59 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.230396:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:1.0:1789607510.230399:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607510.230401:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184a00, rc 0) 00000100:00100000:1.0:1789607510.230901:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:12561:x1876539130083712:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1851us (2320us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789607510.230910:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 215 00000100:00100000:2.0:1789607510.245503:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.245587:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130083840 00000100:00100000:3.0:1789607510.245597:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130083840 00000100:00100000:3.0:1789607510.245658:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 216 00000100:00100000:3.0:1789607510.245674:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:12561:x1876539130083840:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1789607510.245745:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245782:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245795:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245834:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245842:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245849:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245855:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607510.245891:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245900:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245912:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607510.245915:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607510.245919:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.245935:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.246007:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:12561:x1876539130083840:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 340us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.246014:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 216 00010000:00010000:0.0:1789607510.247430:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607510.257619:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.257721:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130084096 00000100:00100000:1.0:1789607510.257732:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130084096 00000100:00100000:1.0:1789607510.257808:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:1.0:1789607510.257818:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790118d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+59:12561:x1876539130084096:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607510.258093:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790118d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:12561:x1876539130084096:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 275us (482us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789607510.258100:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:2.0:1789607510.378294:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.378508:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130084352 00000100:00100000:0.0:1789607510.378518:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130084352 00000100:00100000:0.0:1789607510.378576:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:0.0:1789607510.378586:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:12571:x1876539130084352:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607510.378611:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607510.378614:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789607510.378650:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe43b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bb0 expref: 60 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.378687:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607510.378692:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607510.379248:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe4c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bd3 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.379347:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe4c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.379361:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.379372:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607510.379384:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789607510.379508:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe4c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bd3 expref: 62 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.379523:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bd3 expref: 61 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.379530:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607510.379533:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607510.379535:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8800, rc 0) 00000100:00100000:0.0:1789607510.379605:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:12571:x1876539130084352:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1020us (1320us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789607510.379612:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:2.0:1789607510.382435:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.382528:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130084480 00000100:00100000:3.0:1789607510.382537:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130084480 00000100:00100000:3.0:1789607510.382608:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607510.382618:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+61:2396:x1876539130084480:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607510.382647:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607510.382671:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbe4c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bd3 expref: 61 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.382689:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607510.382694:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607510.382756:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:2396:x1876539130084480:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.382764:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:1.0:1789607510.386854:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.387346:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130084736 00000100:00100000:3.0:1789607510.387357:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130084736 00000100:00100000:3.0:1789607510.387578:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:3.0:1789607510.387591:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+60:12571:x1876539130084736:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:3.0:1789607510.387651:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607510.387676:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe4ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bcc expref: 60 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.387704:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607510.387709:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607510.387967:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.387981:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.387991:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607510.388056:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789607510.388080:0:12196:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c7476e9 reply state 00000000e171b176 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.388093:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.388100:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607510.388103:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607510.388106:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607510.388185:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:12571:x1876539130084736:12345-192.168.203.25@tcp:36:bash.0 Request processed in 597us (1341us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789607510.388192:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 218 00000020:00080000:3.0:1789607510.388197:0:12196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607510.392145:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.392373:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130084864 00000100:00100000:1.0:1789607510.392386:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130084864 00000100:00100000:1.0:1789607510.392448:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:1.0:1789607510.392459:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+62:12571:x1876539130084864:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607510.392484:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607510.392504:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bda expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.392607:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.392620:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.392631:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607510.392659:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789607510.392662:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607510.392680:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.393172:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe4dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 64 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.393194:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 63 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.393202:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:1.0:1789607510.393205:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607510.393209:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185e00, rc 0) 00000100:00100000:1.0:1789607510.393276:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12571:x1876539130084864:12345-192.168.203.25@tcp:101:bash.0 Request processed in 818us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.393284:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:2.0:1789607510.397189:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.397271:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130085120 00000100:00100000:1.0:1789607510.397282:0:14272:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130085120 00000100:00100000:1.0:1789607510.397355:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1789607510.397363:0:14272:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+63:12571:x1876539130085120:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:1.0:1789607510.397577:0:14272:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12571:x1876539130085120:12345-192.168.203.25@tcp:35:bash.0 Request processed in 214us (398us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789607510.397584:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1789607510.467841:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.468042:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130085248 00000100:00100000:0.0:1789607510.468053:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130085248 00000100:00100000:0.0:1789607510.468117:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 220 00000100:00100000:0.0:1789607510.468127:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+64:12577:x1876539130085248:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607510.468151:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607510.468172:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe4ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668be1 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.468233:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe4f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.468248:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.468258:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607510.468291:0:7709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789607510.468295:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607510.468313:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.468334:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe4ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be1 expref: 66 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.468351:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be1 expref: 65 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.468358:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607510.468361:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607510.468377:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9e00, rc 0) 00000100:00100000:0.0:1789607510.468439:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12577:x1876539130085248:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 314us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.468446:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 220 00000100:00100000:2.0:1789607510.472254:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.472338:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130085376 00000100:00100000:3.0:1789607510.472348:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130085376 00000100:00100000:3.0:1789607510.472403:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 221 00000100:00100000:3.0:1789607510.472414:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12577:x1876539130085376:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607510.472437:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607510.472456:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe4f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668be8 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472520:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472534:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472566:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472578:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472585:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472592:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472678:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472686:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472693:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607510.472727:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789607510.472731:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607510.472763:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472783:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472792:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472808:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472815:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472822:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607510.472825:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472834:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472846:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607510.472849:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607510.472854:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472902:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe4ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472915:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472920:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472926:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472930:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607510.472940:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472947:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472954:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:3.0:1789607510.472956:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607510.472959:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472964:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe506 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.472990:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe4f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 67 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.473003:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 66 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.473009:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607510.473011:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607510.473013:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f600, rc 0) 00000100:00100000:3.0:1789607510.473071:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12577:x1876539130085376:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 658us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.473079:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 221 00000100:00100000:3.0:1789607510.477763:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.477817:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.477934:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130085632 00000100:00100000:1.0:1789607510.477944:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130085632 00000100:00100000:1.0:1789607510.478010:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 222 00000100:00100000:1.0:1789607510.478021:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12577:x1876539130085632:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607510.478041:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607510.478064:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe514 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bef expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478166:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478181:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478188:0:6469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 67 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478196:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478228:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 67 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478261:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 67 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607510.478274:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150062976:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607510.478367:0:6469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.478376:0:6469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607510.478384:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150063104:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607510.478406:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607510.478542:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130085760 00000100:00100000:2.0:1789607510.478547:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130085760 00010000:00010000:2.0:1789607510.478571:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 68 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607510.478602:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:2.0:1789607510.478611:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:2395:x1876539130085760:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607510.478621:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607510.478628:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 68 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.478641:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 68 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.478658:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607510.478663:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.478671:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.478689:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607510.478714:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:2395:x1876539130085760:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 105us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.478722:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 96 00010000:00010000:0.0:1789607510.485740:0:6469:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.25@tcp) returned -22 from blocking AST (req@00000000410b9cdf x1876539150062976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 67 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.485782:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f600/0xa26202d240fbe50d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be8 expref: 67 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607510.485800:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150062976:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607510.485813:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6469:1876539150063104:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607510.485836:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607510.485841:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.485850:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.485881:0:6469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.487628:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.487700:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130085888 00000100:00100000:0.0:1789607510.487711:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130085888 00010000:00010000:0.0:1789607510.487755:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607510.487792:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:0.0:1789607510.487818:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:2396:x1876539130085888:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607510.487834:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607510.487841:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.487853:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.487910:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbe4e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bda expref: 67 pid: 6469 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.487937:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607510.487942:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.487952:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.487960:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.487987:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607510.488042:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:2396:x1876539130085888:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 226us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.488049:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 97 00010000:00010000:2.0:1789607510.488931:0:6469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.488943:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607510.488962:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789607510.489104:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185000/0xa26202d240fbe514 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 67 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.489123:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 66 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.489131:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607510.489134:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607510.489136:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184a00, rc 0) 00000100:00100000:2.0:1789607510.489192:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12577:x1876539130085632:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 11173us (11452us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789607510.489199:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 222 00000100:00100000:3.0:1789607510.493449:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.493621:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086144 00000100:00100000:2.0:1789607510.493631:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086144 00000100:00100000:2.0:1789607510.493696:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:2.0:1789607510.493706:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78facc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12577:x1876539130086144:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:2.0:1789607510.493730:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607510.493763:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe47a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bc5 expref: 66 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.493790:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607510.493795:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607510.493849:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78facc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12577:x1876539130086144:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 145us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.493857:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1789607510.496415:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.496792:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086272 00000100:00100000:2.0:1789607510.496802:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086272 00000100:00100000:2.0:1789607510.496882:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 223 00000100:00100000:2.0:1789607510.496892:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12577:x1876539130086272:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1789607510.497010:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.497027:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.497039:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607510.497340:0:6468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789607510.497429:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12577:x1876539130086272:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 538us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.497438:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 223 00000100:00100000:3.0:1789607510.500087:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.500214:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086400 00000100:00100000:2.0:1789607510.500225:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086400 00000100:00100000:2.0:1789607510.500294:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 224 00000100:00100000:2.0:1789607510.500304:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+65:12577:x1876539130086400:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607510.500341:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607510.500360:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bf6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.500413:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.500424:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 66 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.500440:0:6470:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.500456:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 66 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.500469:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607510.500472:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607510.500475:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 66 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.500483:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581e00, rc 0) 00000100:00100000:2.0:1789607510.500583:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12577:x1876539130086400:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 280us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.500590:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 224 00000100:00100000:0.0:1789607510.532581:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.532738:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.532784:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.532828:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086912 00000100:00100000:3.0:1789607510.532838:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086912 00000100:00100000:3.0:1789607510.532953:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:3.0:1789607510.532964:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130086912:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607510.533035:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130086912:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.533042:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:0.0:1789607510.533931:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.533980:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.534000:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086784 00000100:00100000:0.0:1789607510.534007:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086784 00000100:00100000:0.0:1789607510.534039:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:0.0:1789607510.534046:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130086784:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607510.534088:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2396:x1876539130086784:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.534094:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:0.0:1789607510.534147:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.534192:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086528 00000100:00100000:1.0:1789607510.534196:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086528 00000100:00100000:1.0:1789607510.534225:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 387 00000100:00100000:1.0:1789607510.534232:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130086528:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607510.534260:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130086528:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.534266:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 387 00000100:00100000:2.0:1789607510.541112:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130086656 00000100:00100000:2.0:1789607510.541149:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130086656 00000100:00100000:2.0:1789607510.541236:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130087168 00000100:00100000:2.0:1789607510.541240:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130087168 00000100:00100000:2.0:1789607510.541274:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 335 00000100:00100000:2.0:1789607510.541286:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c5f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130086656:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607510.541381:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c5f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130086656:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (8811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.541388:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 335 00000100:00100000:2.0:1789607510.541410:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 336 00000100:00100000:2.0:1789607510.541417:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c6580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130087168:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607510.541442:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c6580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130087168:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (8658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.541448:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 336 00000100:00080000:1.0:1789607510.541765:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789607510.542075:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130087040 00000100:00100000:2.0:1789607510.542081:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130087040 00000100:00100000:2.0:1789607510.542130:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 337 00000100:00100000:2.0:1789607510.542139:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130087040:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607510.542176:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130087040:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 40us (8029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.542183:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 337 00000100:00080000:1.0:1789607510.542249:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789607510.754087:0:9400:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415711222445ns, next at 416711220024ns, rc = 0 00000100:00100000:2.0:1789607510.754089:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150063232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607510.754173:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607510.754499:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150063360:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.754534:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754553:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150063488:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.754560:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150063872:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.754581:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754582:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607510.754598:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150064384:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754612:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150064000:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.754618:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754630:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754642:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150064512:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.754647:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150063360 00000100:00100000:3.0:1789607510.754653:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150063360 00000100:00100000:1.0:1789607510.754663:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754686:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150063744:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.754692:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789607510.754700:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150063360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754705:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754717:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150064256:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754736:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754764:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150064768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754793:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754822:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789607510.754829:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150063616:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754852:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754890:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150064128:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754909:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754925:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150064640:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.754943:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.754963:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064384 00000100:00100000:1.0:1789607510.754966:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064384 00000100:00100000:1.0:1789607510.754991:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064256 00000100:00100000:1.0:1789607510.754994:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064256 00000100:00100000:1.0:1789607510.755015:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064768 00000100:00100000:1.0:1789607510.755018:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064768 00000100:00100000:3.0:1789607510.755020:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3468:x1876539150063360:12345-0@lo:400:kworker.0 Request processed in 320us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.755028:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789607510.755032:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789607510.755037:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150064384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.755056:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150063872 00000100:00100000:3.0:1789607510.755059:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150063872 00000100:00100000:1.0:1789607510.755068:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150064384:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.755080:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150063616 00000100:00100000:1.0:1789607510.755080:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789607510.755082:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150063616 00000100:00100000:1.0:1789607510.755093:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607510.755098:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150064256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.755102:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789607510.755107:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150063872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755130:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150064256:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.755132:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150063872:12345-0@lo:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.755135:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789607510.755137:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789607510.755146:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789607510.755146:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789607510.755152:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150063616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755152:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150064768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.755177:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150063616:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.755178:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150064768:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.755184:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789607510.755184:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789607510.755199:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607510.755202:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607510.755220:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150063872:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755220:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150063616:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755230:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150064256:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.755231:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150064384:0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.755238:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150063360:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755238:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150064768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755263:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150063488 00000100:00100000:1.0:1789607510.755266:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150063488 00000100:00100000:1.0:1789607510.755283:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064000 00000100:00100000:1.0:1789607510.755286:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064000 00000100:00100000:1.0:1789607510.755311:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064512 00000100:00100000:1.0:1789607510.755313:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064512 00000100:00100000:1.0:1789607510.755324:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150063744 00000100:00100000:1.0:1789607510.755326:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150063744 00000100:00100000:1.0:1789607510.755336:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064128 00000100:00100000:1.0:1789607510.755338:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064128 00000100:00100000:1.0:1789607510.755363:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150064640 00000100:00100000:1.0:1789607510.755367:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150064640 00000100:00100000:1.0:1789607510.755378:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789607510.755383:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150063488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755418:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150063488:12345-0@lo:400:kworker.0 Request processed in 35us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.755424:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789607510.755447:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150063488:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755465:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789607510.755470:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150064000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755502:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150064000:12345-0@lo:400:kworker.0 Request processed in 32us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.755507:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789607510.755528:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150064000:0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755544:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789607510.755550:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d8ac3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150064512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607510.755583:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d8ac3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150064512:12345-0@lo:400:kworker.0 Request processed in 34us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.755588:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:3.0:1789607510.756010:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607510.756014:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607510.757250:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789607510.757265:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150063744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607510.757354:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150063744:12345-0@lo:400:kworker.0 Request processed in 93us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.757373:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789607510.757392:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789607510.757398:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150063744:0@lo:400:kworker.0 00000100:00100000:2.0:1789607510.757399:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150064128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607510.757436:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150064128:12345-0@lo:400:kworker.0 Request processed in 38us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.757442:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:3.0:1789607510.757452:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffac700 x1876539150064128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607510.757452:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789607510.757458:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150064640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607510.757464:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150064128:0@lo:400:kworker.0 00000100:00100000:2.0:1789607510.757504:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150064640:12345-0@lo:400:kworker.0 Request processed in 46us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.757510:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00080000:3.0:1789607510.757522:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703100 x1876539150064640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607510.757531:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150064640:0@lo:400:kworker.0 00000100:00100000:2.0:1789607510.758080:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150064512:0@lo:400:kworker.0 00000100:00100000:0.0:1789607510.758205:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150063232 00000100:00100000:0.0:1789607510.758212:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150063232 00000100:00100000:0.0:1789607510.758259:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789607510.758266:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150063232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607510.758294:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607510.758341:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150063232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (4168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.758347:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000040:00080000:0.0:1789607510.758490:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607510.758495:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607510.758533:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789607510.758539:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607510.758637:0:13335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150064896:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607510.758708:0:13335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2f00 going to sleep for 11 seconds 00000100:00080000:0.0:1789607510.758752:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607510.758800:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150063232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607510.759260:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607510.759271:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150065024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607510.759431:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607510.761901:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150065024 00000100:00100000:0.0:1789607510.762034:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150065024 00000100:00100000:0.0:1789607510.762098:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789607510.762108:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150065024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607510.762130:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607510.762247:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150065024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.762254:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607510.763115:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150065024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607510.764382:0:13335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150064896:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607510.764493:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.764600:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130087296 00000100:00100000:0.0:1789607510.764920:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130087296 00000100:00100000:0.0:1789607510.764975:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 225 00000100:00100000:0.0:1789607510.765170:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12578:x1876539130087296:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607510.765200:0:12196:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607510.765302:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12578:x1876539130087296:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 317us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.765309:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 225 00000100:00100000:0.0:1789607510.772013:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.772289:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130087424 00000100:00100000:2.0:1789607510.772298:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130087424 00000100:00100000:2.0:1789607510.772358:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 226 00000100:00100000:2.0:1789607510.772370:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12578:x1876539130087424:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789607510.778418:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.778446:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.778461:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779051:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779061:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779069:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779095:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779103:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779110:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607510.779155:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789607510.779160:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607510.779174:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779185:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779191:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779197:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779215:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607510.779219:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779227:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779239:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:2.0:1789607510.779242:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607510.779246:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.779251:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe537 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781854:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781894:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781902:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781908:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607510.781913:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781920:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781955:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8d78c6f8c400) 00010000:00010000:2.0:1789607510.781957:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607510.781962:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781967:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe53e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781990:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.781996:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.782001:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.782005:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607510.782008:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.782014:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.782021:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607510.782024:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607510.782027:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.782032:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe545 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607510.782148:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12578:x1876539130087424:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 9775us (10147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.782159:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 226 00000100:00100000:2.0:1789607510.788835:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.789159:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130087680 00000100:00100000:3.0:1789607510.789169:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130087680 00000100:00100000:3.0:1789607510.789230:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:3.0:1789607510.789240:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+66:12578:x1876539130087680:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607510.789259:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607510.789278:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe54c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668bfd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789367:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789381:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789394:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607510.789405:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789607510.789501:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789508:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789514:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789520:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607510.789523:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789543:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789555:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607510.789558:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789607510.789563:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789569:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe553 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789622:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe54c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bfd expref: 68 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789632:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:3.0:1789607510.789634:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607510.789638:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe54c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bfd expref: 68 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.789647:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607510.789743:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12578:x1876539130087680:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 504us (917us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1789607510.789750:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:1.0:1789607510.803409:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.803508:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130087808 00000100:00100000:0.0:1789607510.803518:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130087808 00000100:00100000:0.0:1789607510.803585:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 228 00000100:00100000:0.0:1789607510.803597:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12578:x1876539130087808:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607510.804116:0:12196:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607510.804223:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12578:x1876539130087808:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 626us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.804232:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 228 00000100:00100000:0.0:1789607510.807973:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.808273:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130088064 00000100:00100000:2.0:1789607510.808284:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130088064 00000100:00100000:2.0:1789607510.808347:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:2.0:1789607510.808358:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12578:x1876539130088064:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607510.808380:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607510.808383:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789607510.808410:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe4f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668be1 expref: 67 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.808427:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607510.808432:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607510.808446:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe561 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c04 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607510.809200:0:6470:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789607510.809401:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe568 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.809415:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.809427:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.809814:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe561 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c04 expref: 69 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.809831:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c04 expref: 68 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.809839:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c6f8c400) 00010000:00010000:2.0:1789607510.809842:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607510.809844:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580000, rc 0) 00000100:00100000:2.0:1789607510.810659:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:12578:x1876539130088064:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 2298us (2690us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789607510.810669:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:2.0:1789607510.816017:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.816295:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130088320 00000100:00100000:3.0:1789607510.816305:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130088320 00000100:00100000:3.0:1789607510.816360:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 230 00000100:00100000:3.0:1789607510.816371:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:12578:x1876539130088320:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607510.816440:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607510.816466:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe568 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c04 expref: 68 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816497:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c6f8c400) 00010000:00010000:3.0:1789607510.816509:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607510.816530:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816544:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816554:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816568:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816575:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816582:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816833:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816842:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816849:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816904:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607510.816923:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816933:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816943:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607510.816946:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607510.816950:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816956:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe576 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816967:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816972:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.816978:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.817146:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607510.817150:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.817156:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.817174:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x43f73762 (ffff8d78c13dd300) 00010000:00010000:3.0:1789607510.817177:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607510.817180:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.817185:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe57d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x43f73762 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.817269:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12578:x1876539130088320:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 899us (1259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607510.817276:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 230 00000100:00100000:0.0:1789607510.820171:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.824890:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130088448 00000100:00100000:3.0:1789607510.824904:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130088448 00000100:00100000:3.0:1789607510.824989:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 231 00000100:00100000:3.0:1789607510.825001:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+67:12578:x1876539130088448:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607510.825020:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607510.825042:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe584 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c0b expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.825082:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.825095:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.825106:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.825203:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 69 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.825227:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 68 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.825236:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:3.0:1789607510.825240:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789607510.825243:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ec00, rc 0) 00000100:00100000:3.0:1789607510.825303:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:12578:x1876539130088448:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 304us (5142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.825310:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 231 00000100:00100000:0.0:1789607510.829212:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.829384:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130088704 00000100:00100000:3.0:1789607510.829394:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130088704 00000100:00100000:3.0:1789607510.829459:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 232 00000100:00100000:3.0:1789607510.829470:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+68:12578:x1876539130088704:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607510.829548:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.829564:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.829576:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607510.829984:0:6468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1789607510.830067:0:6468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014d300c7 reply state 000000001afbadcf transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.830080:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.830097:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:3.0:1789607510.830100:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789607510.830104:0:6468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607510.830190:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+70:12578:x1876539130088704:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 721us (990us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789607510.830198:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 232 00000100:00100000:0.0:1789607510.833993:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.834081:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130088832 00000100:00100000:2.0:1789607510.834091:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130088832 00000100:00100000:2.0:1789607510.834146:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 233 00000100:00100000:2.0:1789607510.834155:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+70:12578:x1876539130088832:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607510.834182:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607510.834203:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c12 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.834259:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 71 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.834273:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 71 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.834309:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:2.0:1789607510.834312:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607510.834315:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581000, rc 0) 00000100:00100000:2.0:1789607510.834369:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+71:12578:x1876539130088832:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 215us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.834375:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 233 00000100:00100000:0.0:1789607510.841193:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.841285:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130088960 00000100:00100000:1.0:1789607510.841293:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130088960 00000100:00100000:1.0:1789607510.841344:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:1.0:1789607510.841354:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2396:x1876539130088960:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789607510.842201:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2396:x1876539130088960:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 845us (1015us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789607510.842211:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:0.0:1789607510.846289:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.847444:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130089216 00000100:00100000:3.0:1789607510.847455:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130089216 00000100:00100000:3.0:1789607510.847522:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:3.0:1789607510.847531:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+71:12578:x1876539130089216:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607510.847756:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+72:12578:x1876539130089216:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 225us (1477us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789607510.847764:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:0.0:1789607510.855678:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.855786:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130089472 00000100:00100000:2.0:1789607510.855797:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130089472 00000100:00100000:2.0:1789607510.855858:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 234 00000100:00100000:2.0:1789607510.855901:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+72:12578:x1876539130089472:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789607510.856019:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+72:12578:x1876539130089472:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.856026:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 234 00000100:00100000:2.0:1789607510.862338:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.863037:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130089600 00000100:00100000:3.0:1789607510.863048:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130089600 00000100:00100000:3.0:1789607510.863107:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 235 00000100:00100000:3.0:1789607510.863116:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+72:12578:x1876539130089600:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607510.863135:0:7709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607510.863156:0:7709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe5a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c19 expref: -99 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.863229:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe5a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.863243:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.863273:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607510.863312:0:7709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607510.863331:0:7709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.863358:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe5a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c19 expref: 74 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.863377:0:7709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c19 expref: 73 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.863385:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:3.0:1789607510.863387:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607510.863391:0:7709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607510.863453:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+73:12578:x1876539130089600:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 338us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.863460:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 235 00000100:00100000:0.0:1789607510.870851:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.871129:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130089728 00000100:00100000:2.0:1789607510.871138:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130089728 00000100:00100000:2.0:1789607510.871198:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:2.0:1789607510.871208:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+10:2394:x1876539130089728:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607510.871226:0:9649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607510.871248:0:9649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c20 expref: -99 pid: 9649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607510.871276:0:9649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3e57, blocks: 0x1 00010000:00010000:2.0:1789607510.871297:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1789607510.871316:0:9649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607510.871326:0:9649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 11 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.871346:0:9649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 11 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.871360:0:9649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607510.871422:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:2394:x1876539130089728:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 215us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.871429:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1789607510.876045:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.876256:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130089984 00000100:00100000:3.0:1789607510.876267:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130089984 00000100:00100000:3.0:1789607510.876326:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 236 00000100:00100000:3.0:1789607510.876336:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+73:12578:x1876539130089984:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607510.876442:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+73:12578:x1876539130089984:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 107us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607510.876449:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 236 00000100:00100000:3.0:1789607510.884994:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607510.885271:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130090112 00000100:00100000:0.0:1789607510.885281:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130090112 00000100:00100000:0.0:1789607510.885337:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:0.0:1789607510.885347:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:12578:x1876539130090112:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607510.885365:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607510.885383:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c27 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.885414:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 12 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.885423:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607510.885427:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607510.885432:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.885463:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 12 pid: 9649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.885487:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 12 pid: 9649 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607510.885508:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8112:1876539150065152:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607510.885636:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607510.900820:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.900904:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130090240 00000100:00100000:3.0:1789607510.900913:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130090240 00010000:00010000:3.0:1789607510.900965:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 13 pid: 9649 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.901009:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:3.0:1789607510.901019:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2395:x1876539130090240:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607510.901033:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607510.901053:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 13 pid: 9649 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.901068:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 13 pid: 9649 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.901091:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607510.901097:0:6456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607510.901104:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.901114:0:6456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.901150:0:6456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.901164:0:6456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6456:1876539150065280:192.168.203.25@tcp:105: 00000100:00100000:3.0:1789607510.901259:0:6456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607510.904284:0:6456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6456:1876539150065280:192.168.203.25@tcp:105: 00010000:00010000:0.0:1789607510.904311:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607510.904369:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2395:x1876539130090240:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 3350us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607510.904379:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 98 00010000:00010000:2.0:1789607510.906208:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbe5ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c20 expref: 12 pid: 9649 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607510.906231:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8112:1876539150065152:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607510.906259:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.906273:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8800, rc 0) 00000100:00100000:2.0:1789607510.906382:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:12578:x1876539130090112:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 21036us (21398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.906390:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:0.0:1789607510.911381:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.912134:0:8117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130090368 00000100:00100000:2.0:1789607510.912147:0:8117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130090368 00002000:00100000:0.0:1789607510.912275:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d78f075dc00 x1876539130090368/t0(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:66/0 lens 504/0 e 0 to 0 dl 1789607521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607510.912285:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78f075dc00 with x1876539130090368 ext(0->12) 00002000:00010000:0.0:1789607510.912290:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78f075dc00 00000100:00100000:0.0:1789607510.912364:0:8117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:0.0:1789607510.912375:0:8117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+11:2394:x1876539130090368:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789607510.913106:0:8117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2394:x1876539130090368:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 730us (1732us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789607510.913115:0:8117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00002000:00100000:0.0:1789607510.913122:0:8117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d78f075dc00 x1876539130090368/t4294967321(0) o4->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:66/0 lens 504/448 e 0 to 0 dl 1789607521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607510.913133:0:8117:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78f075dc00 with x1876539130090368 ext(0->12) 00002000:00010000:0.0:1789607510.913137:0:8117:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78f075dc00 00000100:00100000:0.0:1789607510.916685:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607510.916958:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130090496 00000100:00100000:3.0:1789607510.916968:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130090496 00000100:00100000:3.0:1789607510.917032:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 237 00000100:00100000:3.0:1789607510.917043:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+73:12578:x1876539130090496:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789607510.969491:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000001:00080000:0.0:1789607510.969521:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:0.0:1789607510.969542:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1789607510.969551:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789607510.969572:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78cfcf9d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789607510.969576:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f61acb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78cfcf9180 00000020:00080000:0.0:1789607510.969579:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f61ac300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7900ee9000 00000020:00080000:0.0:1789607510.969587:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1789607510.969593:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789607510.969602:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:1.0:1789607510.969758:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969779:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969787:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969794:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.969798:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969814:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969830:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d78c6f8c700) 00010000:00010000:1.0:1789607510.969833:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607510.969838:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969844:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184600/0xa26202d240fbe2d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969894:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969900:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969927:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969933:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.969936:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969942:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969949:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d78c6f8cb00) 00010000:00010000:1.0:1789607510.969952:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607510.969955:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969961:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbe370 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.969994:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970000:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970006:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970011:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.970014:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970028:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970036:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:1.0:1789607510.970038:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607510.970041:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970048:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe3ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970058:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970064:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970071:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970076:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.970078:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970084:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970090:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8c800) 00010000:00010000:1.0:1789607510.970092:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607510.970094:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970103:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8600/0xa26202d240fbe411 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970117:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970123:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970137:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970142:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607510.970145:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970150:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970158:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:1.0:1789607510.970160:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607510.970163:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.970169:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f200/0xa26202d240fbe592 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607510.970818:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789607510.970842:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78e0938780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789607510.970846:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78d0168800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78e0938b40 00000020:00080000:0.0:1789607510.970849:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78d0168200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d78f62f5000 00010000:00010000:0.0:1789607510.970895:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.970902:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.970909:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.970914:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607510.971038:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971047:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971067:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607510.971069:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607510.971073:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971079:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ee00/0xa26202d240fbe4d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607510.971228:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150065408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789607510.971291:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607510.971350:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150065408 00000100:00100000:0.0:1789607510.971358:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150065408 00000100:00100000:0.0:1789607510.971400:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789607510.971409:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150065408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789607510.971432:0:8114:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1789607510.971452:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971585:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 12 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971597:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789607510.971601:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607510.971673:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971699:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 12 pid: 8113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607510.971719:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 12 pid: 8113 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607510.971731:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150065536:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607510.971795:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607510.974160:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607510.974179:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150065664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789607510.974235:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607510.974292:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150065664 00000100:00100000:1.0:1789607510.974299:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150065664 00000100:00100000:1.0:1789607510.974340:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789607510.974348:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3471:x1876539150065664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789607510.974371:0:13082:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1789607510.974403:0:13082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aab3e56, atime: 0x6aab3e56, ctime: 0x6aab3e56, blocks: 0x1 00010000:00010000:1.0:1789607510.974411:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.974426:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1789607510.974430:0:13082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607510.974436:0:13082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.974451:0:13082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.974461:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.974469:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.974496:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607510.975731:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3471:x1876539150065664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1379us (1492us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789607510.975742:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000020:00080000:2.0:1789607510.975917:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789607510.976049:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1789607510.976068:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607510.976077:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.976089:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607510.976094:0:6458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.976105:0:6458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.976125:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.976132:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a0a637/0xa26202d240fbe5c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607510.976152:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607510.976153:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607510.976155:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789607510.976431:0:3471:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78fcb7ed80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789607510.976439:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150065664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789607510.977403:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607510.977455:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130090624 00000100:00100000:1.0:1789607510.977463:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130090624 00010000:00010000:1.0:1789607510.977506:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 13 pid: 8113 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607510.977541:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:1.0:1789607510.977550:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2396:x1876539130090624:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607510.977563:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607510.977569:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 13 pid: 8113 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.977582:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 13 pid: 8113 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.977792:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607510.977798:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607510.977811:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.977823:0:6454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.977844:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607510.977913:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+13:2396:x1876539130090624:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 363us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607510.978050:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 99 00010000:00010000:3.0:1789607510.979264:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000096e31a0/0xa26202d240fbe37e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b86 expref: 12 pid: 8113 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607510.979287:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150065536:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607510.979310:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.979320:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.979326:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.979336:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.979342:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607510.979371:0:8114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789607510.980375:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150065408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8964us (9080us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789607510.980386:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789607510.980463:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607510.980484:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.980495:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607510.980500:0:6457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.980511:0:6457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.980530:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.980538:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5f2a98/0xa26202d240fbe5bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607510.980557:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607510.980558:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607510.980560:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789607510.980795:0:3469:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78f075c700/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789607510.980821:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150065408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789607510.981303:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:12578:x1876539130090496:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 64260us (64623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607510.981313:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 237 00000100:00100000:0.0:1789607510.984167:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607510.984257:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130090752 00000100:00100000:2.0:1789607510.984266:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130090752 00000100:00100000:2.0:1789607510.984356:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:2.0:1789607510.984369:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+12:2393:x1876539130090752:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789607511.014937:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789607511.014974:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:3.0:1789607511.014988:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1789607511.015494:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130090752:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 31122us (31329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607511.015506:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:0.0:1789607511.019012:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607511.019160:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130091008 00000100:00100000:3.0:1789607511.019170:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130091008 00000100:00100000:3.0:1789607511.019254:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 238 00000100:00100000:3.0:1789607511.019266:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:12578:x1876539130091008:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607511.019315:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607511.019340:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe5a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c19 expref: 21 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.019360:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:3.0:1789607511.019364:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607511.019402:0:7709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.019415:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.019425:0:7709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607511.019570:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1789607511.021335:0:7709:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa7d017a reply state 0000000013fb8741 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.021362:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.021441:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:2.0:1789607511.021444:0:7709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607511.021448:0:7709:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607511.021741:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:12578:x1876539130091008:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 2474us (2734us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789607511.021751:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 238 00000100:00100000:3.0:1789607511.024173:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607511.024265:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130091136 00000100:00100000:1.0:1789607511.024275:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130091136 00000100:00100000:1.0:1789607511.024364:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:1.0:1789607511.024383:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2394:x1876539130091136:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789607511.024629:0:8113:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789607511.024633:0:8113:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789607511 00002000:00010000:1.0:1789607511.024635:0:8113:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789607510 00002000:00010000:1.0:1789607511.024637:0:8113:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789607511 -> 1789607511 00002000:00010000:1.0:1789607511.024640:0:8113:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789607511.024700:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130091136:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 318us (533us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789607511.024708:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00080000:0.0:1789607511.026151:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607511.029024:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607511.029112:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130091392 00000100:00100000:2.0:1789607511.029123:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130091392 00000100:00100000:2.0:1789607511.029179:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 239 00000100:00100000:2.0:1789607511.029189:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:12578:x1876539130091392:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789607511.029256:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.029274:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 22 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.029283:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.029316:0:6470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 22 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.029330:0:6470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 22 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.029358:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150065792:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607511.029445:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0d7de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607511.033214:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150065792:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607511.033244:0:6470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607511.034646:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607511.034968:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130091520 00000100:00100000:2.0:1789607511.034977:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130091520 00010000:00010000:2.0:1789607511.035014:0:6455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 23 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.035084:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:2.0:1789607511.035093:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:2395:x1876539130091520:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607511.035107:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607511.035115:0:6455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 23 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.035127:0:6455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 23 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.035149:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571ec00/0xa26202d240fbe58b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c0b expref: 23 pid: 12196 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.035165:0:6455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:2.0:1789607511.035170:0:6455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.035195:0:6455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.035203:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.035235:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607511.035293:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:2395:x1876539130091520:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 200us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607511.035301:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 100 00010000:00010000:3.0:1789607511.035888:0:6470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.035899:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036583:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036592:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036599:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036605:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607511.036609:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036618:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036632:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:3.0:1789607511.036635:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789607511.036639:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.036645:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe5d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607511.036735:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:12578:x1876539130091392:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 7537us (7708us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789607511.036750:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 239 00000100:00100000:1.0:1789607511.041022:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607511.041259:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130091648 00000100:00100000:3.0:1789607511.041269:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130091648 00000100:00100000:3.0:1789607511.041368:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:3.0:1789607511.041404:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790030e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2393:x1876539130091648:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789607511.041460:0:8114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.041487:0:8114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.041497:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607511.041501:0:8114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607511.041506:0:8114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.041543:0:8114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.041557:0:8114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 8 pid: 8112 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607511.041571:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150065920:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607511.041663:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607511.044270:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8114:1876539150065920:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607511.044316:0:8114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607511.046631:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607511.046855:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130091776 00000100:00100000:2.0:1789607511.046891:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130091776 00010000:00010000:2.0:1789607511.046931:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 9 pid: 8112 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.046975:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:2.0:1789607511.046985:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+9:2395:x1876539130091776:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607511.046999:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607511.047023:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 9 pid: 8112 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.047036:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 9 pid: 8112 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.047060:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c31651cf/0xa26202d240fbe5b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c27 expref: 9 pid: 8112 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.047098:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789607511.047102:0:6454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1789607511.047108:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.047117:0:6454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.047146:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607511.047199:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2395:x1876539130091776:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 215us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607511.047207:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 101 00010000:00010000:3.0:1789607511.049130:0:8114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049148:0:8114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049203:0:8114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049213:0:8114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049222:0:8114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049228:0:8114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607511.049232:0:8114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049241:0:8114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049258:0:8114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.049267:0:8114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008acc1808/0xa26202d240fbe5d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607511.049361:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790030e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130091648:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 7956us (8345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607511.049370:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:3.0:1789607511.053274:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607511.053692:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130092032 00000100:00100000:2.0:1789607511.053702:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130092032 00000100:00100000:2.0:1789607511.053808:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 240 00000100:00100000:2.0:1789607511.053818:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:12578:x1876539130092032:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789607511.053938:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.053958:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.053972:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.054189:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.054217:0:6468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 22 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.054225:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.054256:0:6468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 22 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.054269:0:6468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 22 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.054282:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150066048:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607511.054363:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607511.058337:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607511.058395:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130092160 00000100:00100000:0.0:1789607511.058403:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130092160 00010000:00010000:0.0:1789607511.058436:0:6456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 23 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607511.058469:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:0.0:1789607511.058483:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:2395:x1876539130092160:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607511.058510:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607511.058517:0:6456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 23 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.058529:0:6456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 23 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.058549:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:0.0:1789607511.058554:0:6456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.058563:0:6456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.058570:0:6456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.058586:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607511.058639:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:2395:x1876539130092160:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 162us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607511.058645:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 102 00010000:00010000:1.0:1789607511.059216:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581000/0xa26202d240fbe599 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c12 expref: 22 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607511.059232:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150066048:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607511.059251:0:6468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.059261:0:6468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.059267:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607511.059434:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789607511.059566:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789607511.059711:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789607511.059819:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150066176:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789607511.059900:0:6468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607511.059928:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc32180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607511.060038:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150066176 00000100:00100000:3.0:1789607511.060044:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150066176 00000100:00100000:3.0:1789607511.060079:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789607511.060086:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6468:x1876539150066176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789607511.060153:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6468:x1876539150066176:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607511.060160:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789607511.060246:0:6468:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789607511.060251:0:6468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1789607511.060265:0:6468:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78f075c700, transno 4294967322 00000100:00100000:1.0:1789607511.060342:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150066176:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789607511.061396:0:6468:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789607511.061480:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150066304:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789607511.061533:0:6468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607511.061566:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607511.062038:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150066304 00000100:00100000:1.0:1789607511.062047:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150066304 00000100:00100000:1.0:1789607511.062094:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789607511.062103:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6468:x1876539150066304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789607511.062297:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6468:x1876539150066304:12345-0@lo:1000:mdt00_000.0 Request processed in 195us (764us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789607511.062305:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789607511.062392:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6468:1876539150066304:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789607511.062426:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062435:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062442:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062448:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607511.062452:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062471:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062494:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:2.0:1789607511.062497:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607511.062501:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062506:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062528:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062534:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062538:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062542:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607511.062545:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062550:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062558:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607511.062560:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607511.062567:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 25 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062588:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 25 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062596:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 25 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.062634:0:6468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 25 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.062646:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150066432:192.168.203.25@tcp:105: 00000100:00100000:2.0:1789607511.062715:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607511.068379:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607511.068451:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130092288 00000100:00100000:1.0:1789607511.068462:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130092288 00000100:00100000:1.0:1789607511.068528:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1789607511.068539:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12577:x1876539130092288:12345-192.168.203.25@tcp:49:lfs.0 00000100:00100000:1.0:1789607511.068685:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+26:12577:x1876539130092288:12345-192.168.203.25@tcp:49:lfs.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607511.068692:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:0.0:1789607511.069454:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6468:1876539150066432:192.168.203.25@tcp:105: 00010000:00010000:0.0:1789607511.069489:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069514:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe529 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069547:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069561:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069573:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069583:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069588:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069594:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069600:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607511.069615:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069623:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069633:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607511.069636:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607511.069640:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069654:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5ed lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069665:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069671:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069677:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069681:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607511.069684:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069689:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069696:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607511.069698:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789607511.069701:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.069707:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe5df lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607511.070293:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:12578:x1876539130092032:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 16473us (17024us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789607511.070303:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 240 00000020:00080000:0.0:1789607511.070313:0:6468:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789607511.074021:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607511.074031:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789607511.074641:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607511.074721:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130092544 00000100:00100000:1.0:1789607511.074731:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130092544 00000100:00100000:1.0:1789607511.074798:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 241 00000100:00100000:1.0:1789607511.074809:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:12577:x1876539130092544:12345-192.168.203.25@tcp:58:lfs.0 00000040:00080000:1.0:1789607511.075180:0:7709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789607511.075275:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:12577:x1876539130092544:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 467us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607511.075282:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 241 00000100:00100000:1.0:1789607511.076937:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607511.077590:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130092800 00000100:00100000:0.0:1789607511.077611:0:14272:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130092800 00000100:00100000:0.0:1789607511.077667:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1789607511.077676:0:14272:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e002fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+25:12578:x1876539130092800:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789607511.078501:0:14272:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789607511.078616:0:14272:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1789607511.078660:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.078677:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.078689:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.078698:0:14272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.078704:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.078711:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607511.078727:0:14272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607511.078846:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607511.078854:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.078885:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607511.078890:0:7735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.078899:0:7735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.078911:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:1.0:1789607511.078914:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789607511.078919:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.078925:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8400/0xa26202d240fbe5f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607511.078937:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607511.078939:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607511.078941:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607511.078984:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789607511.078995:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607511.080105:0:14272:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e002fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+27:12578:x1876539130092800:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 2422us (3167us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789607511.080116:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000020:00080000:0.0:1789607511.080131:0:14272:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607511.113563:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607511.114281:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130092928 00000100:00100000:2.0:1789607511.114292:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130092928 00000100:00100000:2.0:1789607511.114355:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 242 00000100:00100000:2.0:1789607511.114376:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+27:12580:x1876539130092928:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607511.114400:0:6470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607511.114426:0:6470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c2e expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.114603:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.114634:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.114645:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.114661:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.114668:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.114675:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.115001:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.115014:0:6470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 28 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.115022:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.115055:0:6470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 28 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.115069:0:6470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 28 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.115094:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150066560:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607511.115189:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607511.118994:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607511.119113:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6470:1876539150066560:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607511.119140:0:6470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607511.122212:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130093184 00000100:00100000:0.0:1789607511.122227:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130093184 00000100:00100000:0.0:1789607511.122335:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:0.0:1789607511.122346:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:6370:x1876539130093184:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789607511.122595:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:6370:x1876539130093184:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 250us (3609us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789607511.122603:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:3.0:1789607511.125084:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607511.125175:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130093312 00000100:00100000:2.0:1789607511.125185:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130093312 00010000:00010000:2.0:1789607511.125222:0:6454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 30 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607511.125266:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:2.0:1789607511.125276:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:2396:x1876539130093312:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607511.125291:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607511.125298:0:6454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 30 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.125310:0:6454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 30 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.125333:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbe51b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bef expref: 30 pid: 6469 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.125351:0:6454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607511.125356:0:6454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.125378:0:6454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.125404:0:6454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607511.125433:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607511.125613:0:6470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125622:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607511.125673:0:6470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789607511.125677:0:6470:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607511.125697:0:6470:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125709:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125719:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125737:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125753:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125773:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607511.125778:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125786:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125796:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607511.125799:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607511.125803:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125809:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581800/0xa26202d240fbe602 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125821:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125827:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125832:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125837:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607511.125846:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125853:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125907:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d78c6f8cc00) 00010000:00010000:3.0:1789607511.125910:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607511.125914:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125920:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125960:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580000/0xa26202d240fbe5fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c2e expref: 30 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125974:0:6470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c2e expref: 29 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607511.125981:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607511.125984:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607511.125986:0:6470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607511.126290:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:2396:x1876539130093312:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1014us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607511.126299:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:3.0:1789607511.129738:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12580:x1876539130092928:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 15259us (16068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607511.130464:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 242 00010000:00010000:2.0:1789607511.266233:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789607511.837647:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789607511.837661:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789607511.837670:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:3.0:1789607511.941729:0:14314:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607511.941821:0:14314:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607511.941989:0:14314:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789607511.941996:0:14314:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789607512.105667:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607512.105676:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607512.105729:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789607512.105735:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789607512.105886:0:13335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150066688:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789607512.105974:0:13335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607512.113020:0:13335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13335:1876539150066688:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607512.122367:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607512.122619:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130093440 00000100:00100000:2.0:1789607512.122629:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130093440 00000100:00100000:2.0:1789607512.122691:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 243 00000100:00100000:2.0:1789607512.122702:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12592:x1876539130093440:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789607512.122752:0:6468:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789607512.122904:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12592:x1876539130093440:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 203us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607512.122911:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 243 00000100:00100000:1.0:1789607512.135200:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607512.135318:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130093696 00000100:00100000:0.0:1789607512.135328:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130093696 00000100:00100000:0.0:1789607512.135392:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 244 00000100:00100000:0.0:1789607512.135402:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+28:12592:x1876539130093696:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607512.135423:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607512.135444:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe617 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c35 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607512.135543:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe61e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607512.135557:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe61e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607512.135569:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe61e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607512.135579:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789607512.135786:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9e00/0xa26202d240fbe617 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c35 expref: 31 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607512.136149:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe61e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c35 expref: 30 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607512.136158:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607512.136161:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607512.136164:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:0.0:1789607512.136296:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:12592:x1876539130093696:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 826us (1036us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789607512.136305:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 244 00000100:00100000:0.0:1789607512.145135:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607512.145208:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607512.145235:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130094080 00000100:00100000:0.0:1789607512.145243:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130094080 00000100:00100000:0.0:1789607512.145296:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1789607512.145306:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:2395:x1876539130094080:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607512.145321:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607512.145343:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbe61e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c35 expref: 30 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607512.145358:0:6456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607512.145363:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607512.145422:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:2395:x1876539130094080:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 117us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607512.145429:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1789607512.146073:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130093952 00000100:00100000:2.0:1789607512.146079:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130093952 00000100:00100000:2.0:1789607512.146121:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 245 00000100:00100000:2.0:1789607512.146130:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+29:12592:x1876539130093952:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789607512.146207:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146220:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146229:0:6470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146407:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146416:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146423:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146429:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607512.146433:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146440:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146449:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:2.0:1789607512.146452:0:6470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607512.146456:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607512.146462:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581200/0xa26202d240fbe62c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607512.146585:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:12592:x1876539130093952:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 456us (1680us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789607512.146593:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 245 00000040:00080000:0.0:1789607512.147552:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607512.147565:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607512.148506:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789607512.148519:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607512.151253:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607512.151310:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130094336 00000100:00100000:1.0:1789607512.151320:0:14272:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130094336 00000100:00100000:1.0:1789607512.151367:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:1.0:1789607512.151376:0:14272:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+30:12592:x1876539130094336:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789607512.151607:0:14272:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:12592:x1876539130094336:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 231us (362us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789607512.151614:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00010000:00010000:1.0:1789607512.290183:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607512.802162:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607512.802185:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150066816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607512.802252:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607512.802262:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150066944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607512.802294:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607512.802335:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150066816 00000100:00100000:0.0:1789607512.802342:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150066816 00000100:00100000:1.0:1789607512.802386:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150066944 00000100:00100000:1.0:1789607512.802390:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150066944 00000100:00100000:0.0:1789607512.802403:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789607512.802411:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150066816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607512.802444:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607512.802498:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150066816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00080000:3.0:1789607512.802555:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607512.802556:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789607512.802562:0:3470:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78f0702d80, transno 4294967308 00000004:00080000:2.0:1789607512.802583:0:3470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789607512.802601:0:3470:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d78fcb7ed80, transno 4294967311 00000100:00100000:2.0:1789607512.802611:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150066816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607512.805848:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789607512.806045:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789607512.806066:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150066944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607512.806093:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607512.806177:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150066944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (3880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607512.806184:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789607512.806579:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150066944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607513.319546:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607513.319576:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150067072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607513.319670:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607513.319742:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067072 00000100:00100000:2.0:1789607513.319765:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067072 00000100:00100000:2.0:1789607513.319837:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789607513.319848:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150067072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607513.319926:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00010000:00010000:1.0:1789607513.319936:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607513.319996:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150067072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607513.320003:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789607513.320053:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150067072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607513.827444:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607513.827477:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150067200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607513.827580:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607513.827997:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067200 00000100:00100000:3.0:1789607513.828009:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067200 00000100:00100000:3.0:1789607513.828071:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789607513.828082:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150067200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607513.828138:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607513.828201:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150067200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607513.828210:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789607513.829552:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150067200:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789607514.059807:0:14365:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607514.059822:0:14365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607514.059901:0:14365:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789607514.059909:0:14365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789607514.299267:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607514.299376:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130094592 00000100:00100000:0.0:1789607514.299390:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130094592 00000100:00100000:0.0:1789607514.299503:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00100000:0.0:1789607514.299516:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+31:12612:x1876539130094592:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607514.299552:0:6468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607514.299580:0:6468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe633 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c3c expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.299711:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe63a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.299750:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe63a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.299768:0:6468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe63a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607514.299794:0:6468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789607514.299985:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe633 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c3c expref: 34 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.300006:0:6468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe63a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c3c expref: 33 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.300015:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607514.300018:0:6468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789607514.300023:0:6468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8200, rc 0) 00000100:00100000:0.0:1789607514.300097:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:12612:x1876539130094592:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 583us (845us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789607514.300104:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00080000:3.0:1789607514.301085:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607514.314648:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607514.314834:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130094720 00000100:00100000:0.0:1789607514.314849:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130094720 00000100:00100000:0.0:1789607514.315056:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00100000:0.0:1789607514.315069:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:12612:x1876539130094720:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1789607514.315165:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315188:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315205:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315239:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315266:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315274:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315282:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607514.315287:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315297:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315314:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:0.0:1789607514.315317:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607514.315324:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607514.315331:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9a00/0xa26202d240fbe648 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607514.315428:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:12612:x1876539130094720:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 360us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607514.315437:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 247 00010000:00010000:2.0:1789607514.340048:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607514.434105:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607514.435769:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130094848 00000100:00100000:1.0:1789607514.435790:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130094848 00000100:00100000:1.0:1789607514.435954:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:1.0:1789607514.435969:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130094848:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:1.0:1789607514.435994:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607514.436025:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ed0086b/0xa26202d240fbe64f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c43 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607514.436085:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aab3e57, atime: 0x6aab3e56, ctime: 0x6aab3e57, blocks: 0xb 00010000:00010000:1.0:1789607514.436113:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1789607514.436119:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607514.436130:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ed0086b/0xa26202d240fbe64f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c43 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607514.436152:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ed0086b/0xa26202d240fbe64f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c43 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789607514.436167:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789607514.436169:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185000, rc 0) 00000100:00100000:1.0:1789607514.436256:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2393:x1876539130094848:12345-192.168.203.25@tcp:101:cat.0 Request processed in 291us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607514.436264:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:1.0:1789607514.444322:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607514.444463:0:8119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130094976 00000100:00100000:0.0:1789607514.444478:0:8119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130094976 00002000:00100000:0.0:1789607514.444552:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d78fcb7c380 x1876539130094976/t0(0) o3->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:70/0 lens 488/0 e 0 to 0 dl 1789607525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607514.444592:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fcb7c380 with x1876539130094976 ext(0->4095) 00002000:00010000:0.0:1789607514.444600:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fcb7c380 00000100:00100000:0.0:1789607514.444637:0:8119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1789607514.444648:0:8119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130094976:12345-192.168.203.25@tcp:3:cat.0 00000100:00100000:0.0:1789607514.445005:0:8119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2394:x1876539130094976:12345-192.168.203.25@tcp:3:cat.0 Request processed in 357us (699us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789607514.445013:0:8119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00002000:00100000:0.0:1789607514.445021:0:8119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d78fcb7c380 x1876539130094976/t0(0) o3->9e7ed4b5-4de4-49ed-8b20-6246d0400cc8@192.168.203.25@tcp:70/0 lens 488/4536 e 0 to 0 dl 1789607525 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607514.445028:0:8119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d78fcb7c380 with x1876539130094976 ext(0->4095) 00002000:00010000:0.0:1789607514.445032:0:8119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d78fcb7c380 00010000:00010000:0.0:1789607515.364162:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607515.656451:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607515.656544:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607515.656582:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607515.656625:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095488 00000100:00100000:1.0:1789607515.656647:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095488 00000100:00100000:1.0:1789607515.656721:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:1.0:1789607515.656744:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130095488:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607515.656831:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130095488:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607515.656839:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00080000:1.0:1789607515.656885:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607515.660831:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607515.660890:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607515.661385:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095104 00000100:00100000:1.0:1789607515.661399:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095104 00000100:00100000:1.0:1789607515.661486:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 389 00000100:00100000:1.0:1789607515.661498:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130095104:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607515.661594:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2396:x1876539130095104:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 97us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607515.661602:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 389 00000100:00100000:2.0:1789607515.662823:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095232 00000100:00100000:2.0:1789607515.662839:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095232 00000100:00100000:2.0:1789607515.662921:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095744 00000100:00100000:2.0:1789607515.662925:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095744 00000100:00100000:1.0:1789607515.663144:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 344 00000100:00100000:2.0:1789607515.663216:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 345 00000100:00100000:3.0:1789607515.663647:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607515.663706:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607515.663749:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095360 00000100:00100000:3.0:1789607515.663756:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095360 00000100:00100000:3.0:1789607515.663782:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095872 00000100:00100000:3.0:1789607515.663784:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095872 00000100:00100000:3.0:1789607515.663804:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 346 00000100:00100000:3.0:1789607515.663812:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130095360:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607515.663928:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2396:x1876539130095360:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 116us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607515.663949:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 346 00000100:00100000:3.0:1789607515.663968:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 347 00000100:00100000:3.0:1789607515.663976:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130095872:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607515.664001:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130095872:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607515.664008:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 347 00000100:00100000:3.0:1789607515.664029:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130095616 00000100:00100000:3.0:1789607515.664032:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130095616 00000100:00100000:3.0:1789607515.664062:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:3.0:1789607515.664070:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130095616:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607515.664096:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+8:2396:x1876539130095616:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607515.664130:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00080000:3.0:1789607515.665035:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607515.665043:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607515.665081:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:2396:x1876539130095232:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607515.665163:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+33:2396:x1876539130095232:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 2009us (8729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607515.665173:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 344 00000100:00100000:2.0:1789607515.665853:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130095744:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607515.665952:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2396:x1876539130095744:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 2729us (9368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.665979:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 345 00000100:00100000:2.0:1789607515.874229:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607515.874262:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150067328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607515.874358:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.874457:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067328 00000100:00100000:2.0:1789607515.874467:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067328 00000100:00100000:2.0:1789607515.874539:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789607515.874551:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150067328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607515.874597:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607515.874651:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150067328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.874659:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1789607515.874686:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607515.875042:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150067328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607515.877546:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150067584:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.877635:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.877678:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150068096:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.877700:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.877715:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150068608:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.877743:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.877771:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789607515.877776:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150067456:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.877819:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.877851:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150067968:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.877985:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878006:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150068480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878037:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878073:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067584 00000100:00100000:2.0:1789607515.878082:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067584 00000100:00100000:2.0:1789607515.878134:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068096 00000100:00100000:2.0:1789607515.878137:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068096 00000100:00100000:2.0:1789607515.878166:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068608 00000100:00100000:2.0:1789607515.878169:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068608 00000100:00100000:2.0:1789607515.878189:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789607515.878198:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150067584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878257:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150067584:12345-0@lo:400:kworker.0 Request processed in 60us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.878265:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789607515.878287:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789607515.878293:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150068096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878322:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150068096:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.878327:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789607515.878339:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789607515.878346:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150068608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878374:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150068608:12345-0@lo:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.878380:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789607515.878408:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067968 00000100:00100000:2.0:1789607515.878413:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067968 00000100:00100000:2.0:1789607515.878440:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789607515.878455:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150067968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878490:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150067968:12345-0@lo:400:kworker.0 Request processed in 37us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.878496:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789607515.878515:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068480 00000100:00100000:2.0:1789607515.878519:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068480 00000100:00100000:2.0:1789607515.878547:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789607515.878553:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150068480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878583:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150068480:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.878589:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789607515.878621:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150067840:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878650:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878671:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150068352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878692:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878711:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150068864:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878744:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878773:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789607515.878780:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150067712:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878802:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878832:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150068224:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878853:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878903:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150068736:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.878925:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607515.878950:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068352 00000100:00100000:2.0:1789607515.878962:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068352 00000100:00100000:2.0:1789607515.878988:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068864 00000100:00100000:2.0:1789607515.878992:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068864 00000100:00100000:2.0:1789607515.879014:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789607515.879020:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150068352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879056:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150068352:12345-0@lo:400:kworker.0 Request processed in 36us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.879063:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789607515.879075:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789607515.879081:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150068864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879109:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150068864:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.879115:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789607515.879132:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067840 00000100:00100000:2.0:1789607515.879135:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067840 00000100:00100000:2.0:1789607515.879155:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068224 00000100:00100000:2.0:1789607515.879158:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068224 00000100:00100000:2.0:1789607515.879175:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068736 00000100:00100000:2.0:1789607515.879177:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068736 00000100:00100000:2.0:1789607515.879192:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789607515.879198:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879228:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150067840:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.879234:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789607515.879247:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789607515.879253:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150068224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879282:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150068224:12345-0@lo:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.879298:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789607515.879311:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789607515.879317:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150068736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879347:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150068736:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607515.879352:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:2.0:1789607515.879377:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607515.879383:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607515.879385:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607515.879388:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789607515.879426:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c4413b80 x1876539150068224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607515.879442:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150068224:0@lo:400:kworker.0 00010000:00080000:2.0:1789607515.879453:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075ca80 x1876539150068736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607515.879460:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150068736:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879469:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150067840:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879477:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150068352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879487:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150068864:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879532:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150067968:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879543:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150068480:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879555:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150067584:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879577:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150068096:0@lo:400:kworker.0 00000100:00100000:2.0:1789607515.879588:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150068608:0@lo:400:kworker.0 00000100:00100000:3.0:1789607515.883573:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067456 00000100:00100000:3.0:1789607515.883595:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067456 00000100:00100000:3.0:1789607515.883670:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789607515.883682:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150067456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607515.883814:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3469:x1876539150067456:12345-0@lo:400:kworker.0 Request processed in 134us (5994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607515.883823:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789607515.883891:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150067712 00000100:00100000:3.0:1789607515.883896:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150067712 00000100:00100000:3.0:1789607515.883927:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789607515.883934:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150067712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607515.883981:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150067712:12345-0@lo:400:kworker.0 Request processed in 47us (5178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607515.883987:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789607515.884055:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150067712:0@lo:400:kworker.0 00000100:00100000:3.0:1789607515.884097:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c0415db0-4674-4bfe-9696-a490439e72d4:3469:1876539150067456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607515.884166:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150068992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607515.884207:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607515.884253:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150068992 00000100:00100000:3.0:1789607515.884257:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150068992 00000100:00100000:3.0:1789607515.884288:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789607515.884295:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150068992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607515.884334:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607515.885988:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150068992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607515.886006:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789607515.886104:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150068992:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1789607515.886189:0:9400:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420843325714ns, next at 421843322477ns, rc = 0 00010000:00010000:1.0:1789607516.390633:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789607516.461382:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789607516.461418:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78fc8b7480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789607516.461424:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f61a0500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78fc8b7300 00000020:00080000:0.0:1789607516.461427:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f61a0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d77c5731000 00000020:00080000:0.0:1789607516.461473:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:0.0:1789607516.461482:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1789607516.461543:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789607516.461892:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1789607516.462039:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150069120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789607516.462129:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607516.462319:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607516.462333:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607516.462342:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607516.462349:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607516.462355:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607516.462365:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607516.462386:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d78c13dd800) 00010000:00010000:1.0:1789607516.462407:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607516.462414:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607516.462421:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbe5ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7709 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607516.463054:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789607516.463066:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:2.0:1789607516.478901:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069120 00000100:00100000:2.0:1789607516.478922:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069120 00000100:00100000:2.0:1789607516.479268:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789607516.479281:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150069120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789607516.480278:0:9649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789607516.480288:0:9649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789607511 -> 1789607511 00002000:00010000:2.0:1789607516.480292:0:9649:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1789607510 -> 1789607510 00002000:00010000:2.0:1789607516.480294:0:9649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789607511 -> 1789607511 00002000:00010000:2.0:1789607516.480297:0:9649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789607516.480547:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150069120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1265us (18415us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789607516.480558:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789607516.481750:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789607516.481761:0:3469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789607516.481792:0:3469:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7900a57480 x1876539150069120/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789607532 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789607516.481817:0:3469:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7900a57480/2, rc 0, transno 4294967325 00000100:00100000:0.0:1789607516.481824:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150069120:0@lo:2:osp-syn-1-0.0 00000040:00080000:0.0:1789607517.283399:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607517.283411:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607517.283449:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789607517.283459:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789607517.410089:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607517.858856:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607517.922591:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607517.922625:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150069248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607517.922733:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607517.922984:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069248 00000100:00100000:1.0:1789607517.922994:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069248 00000100:00100000:1.0:1789607517.923072:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607517.923095:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150069248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607517.923143:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607517.923222:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150069248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607517.923230:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607517.923294:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150069248:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789607517.923457:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607517.924027:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607517.924042:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150069376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607517.924104:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607517.924268:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069376 00000100:00100000:0.0:1789607517.924276:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069376 00000100:00100000:0.0:1789607517.924330:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607517.924341:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150069376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607517.924361:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607517.924406:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150069376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607517.924413:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789607517.925026:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607517.925069:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150069376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607518.435208:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150069504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607518.435325:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607518.435917:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069504 00000100:00100000:3.0:1789607518.435929:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069504 00000100:00100000:3.0:1789607518.435986:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789607518.435997:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150069504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607518.436048:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607518.436122:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150069504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607518.436129:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00010000:1.0:1789607518.436528:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607518.436579:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150069504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607518.949211:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150069632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607518.949291:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607518.961771:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069632 00000100:00100000:3.0:1789607518.961787:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069632 00000100:00100000:3.0:1789607518.961890:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789607518.961918:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150069632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607518.961967:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607518.962056:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150069632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (12765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607518.962064:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789607518.962270:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150069632:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789607519.459820:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607520.197568:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607520.202195:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096000 00000100:00100000:2.0:1789607520.202215:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096000 00000100:00100000:2.0:1789607520.202319:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00100000:2.0:1789607520.202332:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12257:x1876539130096000:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789607520.202480:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12257:x1876539130096000:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 151us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607520.202488:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00080000:2.0:1789607520.202519:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607520.213000:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607520.213108:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096128 00000100:00100000:2.0:1789607520.213122:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096128 00000100:00100000:2.0:1789607520.213212:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00100000:2.0:1789607520.213225:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:12257:x1876539130096128:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789607520.213358:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:12257:x1876539130096128:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 136us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607520.213368:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00080000:1.0:1789607520.213616:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607520.234105:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.234826:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096384 00000100:00100000:3.0:1789607520.234840:0:14272:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096384 00000100:00100000:3.0:1789607520.234941:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:3.0:1789607520.234953:0:14272:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:12257:x1876539130096384:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607520.235390:0:14272:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:12257:x1876539130096384:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 437us (1300us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789607520.235400:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00010000:00010000:2.0:1789607520.482234:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607520.773006:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773059:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773096:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773127:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773148:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773167:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773196:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607520.773231:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097024 00000100:00100000:3.0:1789607520.773244:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097024 00000100:00100000:3.0:1789607520.773315:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096896 00000100:00100000:3.0:1789607520.773318:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096896 00000100:00100000:3.0:1789607520.773356:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:3.0:1789607520.773370:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130097024:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607520.773482:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130097024:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 116us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607520.773491:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:3.0:1789607520.773512:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:3.0:1789607520.773520:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130096896:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607520.773545:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130096896:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607520.773551:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:3.0:1789607520.773572:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096768 00000100:00100000:3.0:1789607520.773576:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096768 00000100:00100000:3.0:1789607520.773619:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097280 00000100:00100000:3.0:1789607520.773622:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097280 00000100:00100000:3.0:1789607520.773638:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096640 00000100:00100000:3.0:1789607520.773640:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096640 00000100:00100000:3.0:1789607520.773650:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097152 00000100:00100000:3.0:1789607520.773653:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097152 00000100:00100000:3.0:1789607520.773670:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 354 00000100:00100000:3.0:1789607520.773677:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130096768:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607520.773718:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130096768:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 41us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607520.773724:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 354 00000100:00100000:3.0:1789607520.773737:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 355 00000100:00100000:3.0:1789607520.773743:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130097280:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607520.773768:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130097280:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607520.773785:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 355 00000100:00100000:3.0:1789607520.773797:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 356 00000100:00100000:3.0:1789607520.773803:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:2393:x1876539130096640:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607520.773838:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:2393:x1876539130096640:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607520.773844:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 356 00000100:00100000:3.0:1789607520.773856:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 357 00000100:00100000:3.0:1789607520.773895:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130097152:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607520.773921:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130097152:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 60us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607520.773928:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 357 00000100:00100000:1.0:1789607520.774271:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130096512 00000100:00100000:1.0:1789607520.774284:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130096512 00000100:00100000:1.0:1789607520.774344:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 391 00000100:00100000:1.0:1789607520.774351:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130096512:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607520.774383:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130096512:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607520.774390:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 391 00000100:00080000:1.0:1789607520.774431:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607520.774437:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607520.774440:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607520.774443:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607520.994746:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150069888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607520.994841:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607520.994938:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150070400:0@lo:400:kworker.0 00000100:00100000:1.0:1789607520.995093:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607520.995121:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150070912:0@lo:400:kworker.0 00000100:00100000:1.0:1789607520.995145:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607520.995176:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789607520.995183:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150069760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607520.995214:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607520.995236:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150070272:0@lo:400:kworker.0 00000100:00100000:1.0:1789607520.995264:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607520.995281:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150070784:0@lo:400:kworker.0 00000100:00100000:1.0:1789607520.995306:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607520.995324:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150071296:0@lo:400:kworker.0 00000100:00100000:3.0:1789607520.995643:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069760 00000100:00100000:3.0:1789607520.995654:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069760 00000100:00100000:3.0:1789607520.995726:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789607520.995739:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150069760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607520.995831:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607520.995843:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150071424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607520.996808:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150070144:0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.000901:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150069760:12345-0@lo:400:kworker.0 Request processed in 5148us (5667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.000923:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789607521.001017:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070272 00000100:00100000:3.0:1789607521.001029:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070272 00000100:00100000:3.0:1789607521.001097:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789607521.001107:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150070272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.001177:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150070272:12345-0@lo:400:kworker.0 Request processed in 72us (5912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.001206:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789607521.001282:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150069888 00000100:00100000:3.0:1789607521.001287:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150069888 00000100:00100000:3.0:1789607521.001316:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070400 00000100:00100000:3.0:1789607521.001319:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070400 00000100:00100000:3.0:1789607521.001357:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070912 00000100:00100000:3.0:1789607521.001361:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070912 00000100:00100000:3.0:1789607521.001378:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789607521.001385:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150069888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.003720:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150069888:12345-0@lo:400:kworker.0 Request processed in 2321us (8865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.003740:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789607521.003794:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789607521.003814:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150070400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.003918:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150070400:12345-0@lo:400:kworker.0 Request processed in 116us (8825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.003925:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789607521.003940:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789607521.003948:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150070912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.003989:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150070912:12345-0@lo:400:kworker.0 Request processed in 42us (8841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.003995:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:3.0:1789607521.004041:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607521.004106:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070784 00000100:00100000:3.0:1789607521.004117:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070784 00000100:00100000:3.0:1789607521.004176:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607521.004184:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150070784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.004238:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150070784:12345-0@lo:400:kworker.0 Request processed in 56us (8932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.004244:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607521.004273:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150070016:0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.004316:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607521.004351:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150070528:0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.004375:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607521.004393:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150071040:0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.005581:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607521.005705:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150071552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607521.005763:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607521.005842:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070016 00000100:00100000:3.0:1789607521.005852:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070016 00000100:00100000:3.0:1789607521.005924:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789607521.005935:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150070016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.005999:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150070016:12345-0@lo:400:kworker.0 Request processed in 65us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.006006:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789607521.006040:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070528 00000100:00100000:3.0:1789607521.006045:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070528 00000100:00100000:3.0:1789607521.006081:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071040 00000100:00100000:3.0:1789607521.006085:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071040 00000100:00100000:3.0:1789607521.006105:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789607521.006113:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150070528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.006149:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150070528:12345-0@lo:400:kworker.0 Request processed in 38us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.006175:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789607521.006190:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789607521.006196:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.006228:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150071040:12345-0@lo:400:kworker.0 Request processed in 32us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.006233:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:3.0:1789607521.006262:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607521.006267:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607521.006313:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150070016:0@lo:400:kworker.0 00010000:00080000:3.0:1789607521.006330:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d0aa00 x1876539150070528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607521.006341:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150070528:0@lo:400:kworker.0 00010000:00080000:3.0:1789607521.006350:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78e9d08000 x1876539150071040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607521.006357:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150071040:0@lo:400:kworker.0 00000100:00100000:3.0:1789607521.008671:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607521.008842:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071552 00000100:00100000:3.0:1789607521.008853:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071424 00000100:00100000:2.0:1789607521.008855:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071552 00000100:00100000:3.0:1789607521.008884:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071424 00000100:00100000:3.0:1789607521.008963:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789607521.008975:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150071424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607521.009026:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607521.009095:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150071424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607521.009102:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789607521.018948:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607521.019095:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071296 00000100:00100000:1.0:1789607521.019107:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071296 00000100:00100000:1.0:1789607521.019173:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789607521.019183:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3471:x1876539150071296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019260:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3471:x1876539150071296:12345-0@lo:400:kworker.0 Request processed in 78us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607521.019267:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789607521.019330:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150071296:0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019348:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150069888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019362:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150070400:0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019377:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150070912:0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019427:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150069760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019440:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150070272:0@lo:400:kworker.0 00000100:00100000:1.0:1789607521.019454:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150070784:0@lo:400:kworker.0 00000100:00080000:1.0:1789607521.019512:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607521.019551:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150071424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607521.021109:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789607521.021132:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150071552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607521.021166:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607521.021280:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150071552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (15516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607521.021287:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789607521.021834:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150071552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607521.022006:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607521.022048:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070144 00000100:00100000:0.0:1789607521.022056:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070144 00000100:00100000:0.0:1789607521.022099:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789607521.022107:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150070144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022151:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150070144:12345-0@lo:400:kworker.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607521.022158:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789607521.022213:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150070144:0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022227:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150070656:0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022265:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607521.022289:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150070656 00000100:00100000:0.0:1789607521.022293:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150070656 00000100:00100000:0.0:1789607521.022341:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789607521.022347:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150070656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022385:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150070656:12345-0@lo:400:kworker.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607521.022391:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789607521.022408:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607521.022426:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150070656:0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022434:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150071168:0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022457:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607521.022481:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071168 00000100:00100000:0.0:1789607521.022484:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071168 00000100:00100000:0.0:1789607521.022508:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789607521.022515:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150071168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607521.022546:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150071168:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607521.022552:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789607521.022581:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150071168:0@lo:400:kworker.0 00010000:00010000:1.0:1789607521.506362:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789607521.589450:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1789607521.589484:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789607521.589491:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789607521.589501:0:6501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1789607521.606806:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:02000400:1.0:1789607522.176386:0:14564:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:12:01 (1789607521) 00010000:00010000:3.0:1789607522.529971:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607523.054418:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607523.054440:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150071680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607523.054506:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607523.054580:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071680 00000100:00100000:3.0:1789607523.054588:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071680 00000100:00100000:3.0:1789607523.054643:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789607523.054652:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150071680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607523.054705:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607523.054748:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150071680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607523.054774:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789607523.054825:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150071680:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789607523.062126:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607523.062138:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607523.062169:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150071808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607523.062249:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607523.062305:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071808 00000100:00100000:0.0:1789607523.062316:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071808 00000100:00100000:0.0:1789607523.062367:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789607523.062377:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150071808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607523.062398:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607523.062440:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150071808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607523.062447:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1789607523.062467:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607523.062498:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150071808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607523.555055:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607523.555079:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150071936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607523.555148:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607523.558106:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150071936 00000100:00100000:3.0:1789607523.558122:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150071936 00000100:00100000:3.0:1789607523.558199:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789607523.558208:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150071936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607523.558250:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789607523.558400:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150071936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607523.558408:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:2.0:1789607523.558535:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607523.558692:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150071936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607524.066091:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150072064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607524.066160:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607524.066724:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072064 00000100:00100000:3.0:1789607524.066734:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072064 00000100:00100000:3.0:1789607524.066819:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789607524.066829:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150072064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607524.066899:0:6473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607524.066967:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150072064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607524.066974:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789607524.067056:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150072064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607524.467419:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607524.467493:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097408 00000100:00100000:3.0:1789607524.467503:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097408 00000100:00100000:3.0:1789607524.467581:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 250 00000100:00080000:0.0:1789607524.467583:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607524.467594:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+5:13285:x1876539130097408:12345-192.168.203.25@tcp:101:lsof.0 00010000:00010000:3.0:1789607524.467614:0:6469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607524.467645:0:6469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c4a expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607524.467721:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe65d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607524.467735:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe65d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607524.467749:0:6469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe65d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607524.467782:0:6469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607524.467786:0:6469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607524.467823:0:6469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe65d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607524.467845:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e200/0xa26202d240fbe656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c4a expref: 7 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607524.467909:0:6469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe65d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c4a expref: 6 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607524.467938:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607524.467942:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607524.467945:0:6469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e400, rc 0) 00000100:00100000:3.0:1789607524.468003:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca3bd199-483e-4cd5-beca-47c622e32e26+6:13285:x1876539130097408:12345-192.168.203.25@tcp:101:lsof.0 Request processed in 412us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607524.468010:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 250 00010000:00010000:1.0:1789607524.579086:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607525.602017:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607525.891723:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607525.891768:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607525.891811:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607525.891846:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607525.891899:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607525.892034:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097664 00000100:00100000:3.0:1789607525.892054:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097664 00000100:00100000:3.0:1789607525.892111:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130098176 00000100:00100000:3.0:1789607525.892114:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130098176 00000100:00100000:3.0:1789607525.892133:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097792 00000100:00100000:3.0:1789607525.892136:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097792 00000100:00100000:3.0:1789607525.892156:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 364 00000100:00100000:3.0:1789607525.892166:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:2393:x1876539130097664:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607525.892243:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:2393:x1876539130097664:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 78us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607525.892251:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 364 00000100:00100000:3.0:1789607525.892267:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 365 00000100:00100000:3.0:1789607525.892273:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2393:x1876539130098176:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607525.892298:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2393:x1876539130098176:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607525.892303:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 365 00000100:00100000:3.0:1789607525.892314:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 366 00000100:00100000:3.0:1789607525.892320:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130097792:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607525.892358:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130097792:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607525.892364:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 366 00000100:00100000:3.0:1789607525.892412:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097536 00000100:00100000:3.0:1789607525.892416:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097536 00000100:00100000:3.0:1789607525.892441:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 393 00000100:00100000:3.0:1789607525.892447:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130097536:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607525.892488:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2393:x1876539130097536:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 41us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607525.892494:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 393 00000100:00100000:2.0:1789607525.892884:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130097920 00000100:00100000:2.0:1789607525.892890:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130097920 00000100:00100000:2.0:1789607525.892944:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:2.0:1789607525.892954:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130097920:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607525.892984:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2393:x1876539130097920:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607525.893002:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00080000:0.0:1789607525.893035:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607525.893042:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607525.893044:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607525.893321:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607525.893361:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130098048 00000100:00100000:1.0:1789607525.893369:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607525.893376:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130098048 00000100:00080000:1.0:1789607525.893409:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607525.893421:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:0.0:1789607525.893431:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130098048:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607525.893465:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2393:x1876539130098048:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607525.893483:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:3.0:1789607525.893960:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130098304 00000100:00100000:3.0:1789607525.893965:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130098304 00000100:00100000:3.0:1789607525.894013:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 367 00000100:00100000:3.0:1789607525.894021:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130098304:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607525.894059:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2393:x1876539130098304:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 39us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607525.894066:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 367 00000100:00080000:1.0:1789607525.894643:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607526.114890:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150072192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607526.114972:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607526.116224:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150072320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607526.116376:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607526.117620:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072192 00000100:00100000:3.0:1789607526.117638:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072192 00000100:00100000:3.0:1789607526.117695:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072320 00000100:00100000:3.0:1789607526.117698:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072320 00000100:00100000:3.0:1789607526.117714:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789607526.117722:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150072192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607526.118131:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607526.118213:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150072192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 491us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607526.118237:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789607526.118549:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607526.118604:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150072192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607526.118720:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789607526.118730:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150072320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607526.118748:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607526.119453:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150072448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607526.119507:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607526.119572:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150072576:0@lo:400:kworker.0 00000100:00100000:1.0:1789607526.119599:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607526.119884:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150072320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1155us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607526.119892:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789607526.119919:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072448 00000100:00100000:1.0:1789607526.120159:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072576 00000100:00100000:1.0:1789607526.120164:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072576 00000100:00100000:1.0:1789607526.120202:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789607526.120210:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150072576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607526.120491:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1789607526.120498:0:3470:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7900a57480, transno 4294967325 00000100:00100000:2.0:1789607526.120518:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150072320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607526.121101:0:6462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072448 00000100:00100000:3.0:1789607526.121142:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789607526.121149:0:6462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150072448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607526.121211:0:6462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150072448:12345-0@lo:400:kworker.0 Request processed in 63us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607526.121218:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789607526.121341:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150072448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607526.121500:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150072576:12345-0@lo:400:kworker.0 Request processed in 1288us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607526.121508:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789607526.122154:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150072576:0@lo:400:kworker.0 00000100:00100000:3.0:1789607526.122170:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607526.122179:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150072704:0@lo:400:kworker.0 00000100:00100000:3.0:1789607526.122221:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607526.122417:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072704 00000100:00100000:2.0:1789607526.122425:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072704 00000100:00100000:2.0:1789607526.122471:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789607526.122479:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150072704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607526.122532:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150072704:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607526.122538:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789607526.122568:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150072704:0@lo:400:kworker.0 00000100:00100000:2.0:1789607526.125241:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150072832:0@lo:400:kworker.0 00000100:00100000:2.0:1789607526.125381:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607526.125531:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150072960:0@lo:400:kworker.0 00000100:00100000:1.0:1789607526.125565:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607526.125610:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072960 00000100:00100000:1.0:1789607526.125618:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072960 00000100:00100000:1.0:1789607526.125679:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789607526.125688:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150072960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607526.125744:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150072960:12345-0@lo:400:kworker.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607526.125765:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789607526.125809:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150072960:0@lo:400:kworker.0 00000100:00100000:3.0:1789607526.126223:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150072832 00000100:00100000:3.0:1789607526.126229:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150072832 00000100:00100000:3.0:1789607526.126461:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789607526.126470:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150072832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.126737:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150073472:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.126781:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607526.126808:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607526.126814:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150073344:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.126834:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607526.126876:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073472 00000100:00100000:0.0:1789607526.126881:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073472 00000100:00100000:0.0:1789607526.126916:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073344 00000100:00100000:0.0:1789607526.126919:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073344 00000100:00100000:0.0:1789607526.126952:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607526.126958:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150073472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.126995:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150073472:12345-0@lo:400:kworker.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607526.127001:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607526.127028:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789607526.127033:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150073344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127060:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150073344:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607526.127065:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789607526.127085:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607526.127107:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150073344:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127115:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150073472:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127140:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150073216:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127163:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607526.127183:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150073728:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127220:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607526.127239:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789607526.127256:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150073088:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127276:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607526.127294:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150073600:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127314:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607526.127338:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073216 00000100:00100000:0.0:1789607526.127342:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073216 00000100:00100000:0.0:1789607526.127366:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073728 00000100:00100000:0.0:1789607526.127369:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073728 00000100:00100000:0.0:1789607526.127382:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073088 00000100:00100000:0.0:1789607526.127384:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073088 00000100:00100000:0.0:1789607526.127394:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073600 00000100:00100000:0.0:1789607526.127396:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073600 00000100:00100000:0.0:1789607526.127408:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789607526.127413:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150073216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127449:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150073216:12345-0@lo:400:kworker.0 Request processed in 35us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607526.127455:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789607526.127467:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789607526.127473:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150073728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127498:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150073728:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607526.127503:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789607526.127514:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789607526.127519:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150073088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127545:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150073088:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607526.127557:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789607526.127570:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789607526.127575:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150073600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127604:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150073600:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607526.127609:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:0.0:1789607526.127625:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607526.127628:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607526.127644:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150073088:0@lo:400:kworker.0 00000100:00100000:0.0:1789607526.127663:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150073600:0@lo:400:kworker.0 00010000:00080000:0.0:1789607526.127676:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c52af100 x1876539150073216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607526.127685:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150073216:0@lo:400:kworker.0 00010000:00080000:0.0:1789607526.127694:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd83100 x1876539150073728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607526.127701:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150073728:0@lo:400:kworker.0 00000100:00100000:3.0:1789607526.131480:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150072832:12345-0@lo:400:kworker.0 Request processed in 4998us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607526.131512:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789607526.131596:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150072832:0@lo:400:kworker.0 00000100:00100000:2.0:1789607526.251723:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607526.251795:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130098560 00000100:00100000:0.0:1789607526.251807:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130098560 00000100:00100000:0.0:1789607526.251955:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:0.0:1789607526.251967:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+19:13286:x1876539130098560:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:0.0:1789607526.252296:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:13286:x1876539130098560:12345-192.168.203.25@tcp:35:umount.0 Request processed in 331us (581us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789607526.252305:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:2.0:1789607526.256308:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607526.256412:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130098816 00000100:00100000:0.0:1789607526.256422:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130098816 00000100:00100000:0.0:1789607526.256474:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:0.0:1789607526.256485:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+20:13286:x1876539130098816:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:0.0:1789607526.257154:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:13286:x1876539130098816:12345-192.168.203.25@tcp:35:umount.0 Request processed in 669us (853us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789607526.257223:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:1.0:1789607526.260896:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607526.261137:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130099072 00000100:00100000:0.0:1789607526.261146:0:6472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130099072 00000100:00100000:0.0:1789607526.261339:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:0.0:1789607526.261351:0:6472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e002f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+21:13286:x1876539130099072:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:0.0:1789607526.261565:0:6472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e002f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:13286:x1876539130099072:12345-192.168.203.25@tcp:35:umount.0 Request processed in 216us (709us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789607526.261573:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:2.0:1789607526.265465:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607526.265550:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130099328 00000100:00100000:0.0:1789607526.265560:0:6471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130099328 00000100:00100000:0.0:1789607526.265647:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:0.0:1789607526.265666:0:6471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:13286:x1876539130099328:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:0.0:1789607526.266153:0:6471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:13286:x1876539130099328:12345-192.168.203.25@tcp:35:umount.0 Request processed in 495us (694us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789607526.266162:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:2.0:1789607526.269100:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607526.269181:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607526.270393:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607526.270494:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130099584 00000100:00100000:1.0:1789607526.270504:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130099584 00000100:00100000:1.0:1789607526.270566:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130099456 00000100:00100000:1.0:1789607526.270569:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130099456 00000100:00100000:1.0:1789607526.270594:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:1.0:1789607526.270619:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+14:2394:x1876539130099584:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607526.270641:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607526.270669:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59ce00/0xa26202d240fbd5d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e66878f expref: 14 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607526.270687:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607526.270739:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+13:2394:x1876539130099584:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 122us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607526.270760:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:1.0:1789607526.270780:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1789607526.270787:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+12:2394:x1876539130099456:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607526.270794:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607526.270804:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d000/0xa26202d240fbd696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687ce expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607526.270825:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607526.270846:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:2394:x1876539130099456:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 59us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607526.270852:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1789607526.272113:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607526.272175:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130100096 00000100:00100000:1.0:1789607526.272182:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130100096 00000100:00100000:1.0:1789607526.272224:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:1.0:1789607526.272232:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+7:2392:x1876539130100096:12345-192.168.203.25@tcp:9:umount.0 00000020:00000080:1.0:1789607526.272259:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbdc15 00000020:00010000:1.0:1789607526.272267:0:13082:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d78e9c8e000: total 0 00000100:00080000:1.0:1789607526.272271:0:13082:0:(import.c:65:import_set_state_nolock()) ffff8d78e9c89800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607526.272304:0:13082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789607526.272519:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2392:x1876539130100096:12345-192.168.203.25@tcp:9:umount.0 Request processed in 287us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607526.272526:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000020:00010000:1.0:1789607526.272543:0:6458:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d78e9c8e000: total 0 00010000:00010000:1.0:1789607526.272558:0:6458:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d78e9c8e000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789607526.272603:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f6b694/0xa26202d240fbdfb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a7c expref: 4 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607526.275154:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ed0086b/0xa26202d240fbe64f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c43 expref: 3 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607526.275194:0:6458:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d78e9c8e000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789607526.275219:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607526.275221:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607526.275224:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607526.276120:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130099712 00000100:00100000:0.0:1789607526.276133:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130099712 00000100:00100000:3.0:1789607526.276543:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1789607526.276554:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:2394:x1876539130099712:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607526.276569:0:6454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607526.276584:0:6454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbd8e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688a7 expref: 11 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.276599:0:6454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607526.276666:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2394:x1876539130099712:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 114us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607526.276673:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:2.0:1789607526.281810:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607526.282044:0:8114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130100224 00000100:00100000:1.0:1789607526.282054:0:8114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130100224 00000100:00100000:1.0:1789607526.282098:0:8114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:1.0:1789607526.282107:0:8114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2392:x1876539130100224:12345-192.168.203.25@tcp:9:umount.0 00000020:00000080:1.0:1789607526.282133:0:8114:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd9b4 00000100:00080000:1.0:1789607526.282142:0:8114:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd6f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607526.282189:0:8114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789607526.282578:0:8114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+2:2392:x1876539130100224:12345-192.168.203.25@tcp:9:umount.0 Request processed in 471us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607526.282586:0:8114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00010000:00010000:3.0:1789607526.282768:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607526.293616:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607526.293676:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130101248 00000100:00100000:0.0:1789607526.293685:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130101248 00000100:00100000:0.0:1789607526.293741:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 251 00000100:00100000:0.0:1789607526.293767:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+23:2392:x1876539130101248:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:0.0:1789607526.293803:0:12196:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5e7 00000020:00010000:0.0:1789607526.293816:0:12196:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d77c5519800: total 0 00000100:00080000:0.0:1789607526.293821:0:12196:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ec9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607526.293846:0:12196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1789607526.293852:0:7735:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d77c5519800: total 0 00000100:00100000:0.0:1789607526.294330:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+22:2392:x1876539130101248:12345-192.168.203.25@tcp:39:umount.0 Request processed in 563us (717us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789607526.294338:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 251 00010000:00010000:3.0:1789607526.294623:0:7735:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d77c5519800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1789607526.294664:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607526.294668:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607526.294676:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f400/0xa26202d240fbde99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a2f expref: 21 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.294694:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607526.294697:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607526.294700:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbe610 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c2e expref: 20 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.294713:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607526.294715:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607526.294727:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbd98a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688d1 expref: 19 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.294741:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607526.294743:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607526.294747:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbe013 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a91 expref: 18 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.294757:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d78d9b83d00) 00010000:00010000:3.0:1789607526.294759:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607526.294763:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9600/0xa26202d240fbdc77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6689a3 expref: 17 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.294780:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607526.294782:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607526.294786:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbdf95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a6e expref: 16 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.294798:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607526.294800:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607526.295171:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbe30e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668b6a expref: 15 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295192:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607526.295194:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789607526.295199:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8200/0xa26202d240fbe63a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c3c expref: 14 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295210:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607526.295220:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607526.295225:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580400/0xa26202d240fbe02f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a98 expref: 13 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295244:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c6f8c200) 00010000:00010000:3.0:1789607526.295246:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607526.295250:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580c00/0xa26202d240fbd92f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688bc expref: 12 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295316:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607526.295319:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607526.295324:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f000/0xa26202d240fbdf6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a67 expref: 11 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295343:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d78c73e1600) 00010000:00010000:3.0:1789607526.295346:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607526.295349:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbe530 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668bf6 expref: 10 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295364:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78c73e1000) 00010000:00010000:3.0:1789607526.295366:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607526.295369:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8000/0xa26202d240fbd913 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688b5 expref: 9 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295382:0:7735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d78e28a4300) 00010000:00010000:3.0:1789607526.295384:0:7735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789607526.295388:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e600/0xa26202d240fbdfa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668a75 expref: 8 pid: 7709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607526.295423:0:7735:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d77c5519800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1789607526.295441:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607526.295443:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607526.295446:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607526.305088:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607526.305507:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130101376 00000100:00100000:0.0:1789607526.305516:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130101376 00000100:00100000:0.0:1789607526.305578:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 252 00000100:00100000:0.0:1789607526.305589:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+5:2392:x1876539130101376:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:0.0:1789607526.305620:0:7709:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5ee 00000100:00080000:0.0:1789607526.305648:0:7709:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607526.305687:0:7709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1789607526.305734:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607526.306835:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e7ed4b5-4de4-49ed-8b20-6246d0400cc8+3:2392:x1876539130101376:12345-192.168.203.25@tcp:39:umount.0 Request processed in 1243us (1751us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789607526.306845:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 252 00010000:00010000:3.0:1789607526.626819:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607526.710630:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:1.0:1789607526.710639:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d78e9c8e000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:3.0:1789607526.710888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e9c8e000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-OST0001 00000020:00000080:3.0:1789607526.710940:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78e9c89800 for lustre-OST0001 00000001:00100000:1.0:1789607526.713208:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000001:00080000:1.0:1789607526.713225:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789607526.713237:0:6490:0:(genops.c:885:class_export_put()) final put ffff8d77c5519800/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:0.0:1789607526.713302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c5519800/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-MDT0000 00000020:00000080:0.0:1789607526.713380:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4ec9800 for lustre-MDT0000 00000040:00080000:3.0:1789607527.076332:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1789607527.204936:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:1.0:1789607527.204955:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d78f76ec000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000020:00000080:0.0:1789607527.205039:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f76ec000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-OST0000 00000020:00000080:0.0:1789607527.205104:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fcd6f000 for lustre-OST0000 00000040:00080000:0.0:1789607527.522073:0:13335:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607527.522083:0:13335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607527.523260:0:13335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789607527.523273:0:13335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789607527.652716:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607528.162079:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150073856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607528.162147:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607528.162291:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073856 00000100:00100000:0.0:1789607528.162311:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073856 00000100:00100000:0.0:1789607528.162390:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789607528.162402:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150073856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607528.162434:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607528.162491:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150073856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607528.162499:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1789607528.162854:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607528.162916:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150073856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607528.163625:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607528.163646:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150073984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607528.163689:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607528.163835:0:8115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150073984 00000100:00100000:2.0:1789607528.163842:0:8115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150073984 00000100:00100000:2.0:1789607528.163920:0:8115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789607528.163930:0:8115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150073984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607528.163945:0:8115:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607528.163988:0:8115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150073984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607528.163994:0:8115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607528.164076:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150073984:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789607528.164143:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607528.673998:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607528.674200:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607528.674223:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150074112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607528.674310:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607528.675021:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074112 00000100:00100000:1.0:1789607528.675031:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074112 00000100:00100000:1.0:1789607528.675087:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789607528.675095:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150074112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607528.675132:0:8480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789607528.675196:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150074112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607528.675202:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789607528.675531:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150074112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607528.783791:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607528.783975:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607528.792441:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607528.794694:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130101504 00000100:00100000:3.0:1789607528.794709:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130101504 00000100:00100000:3.0:1789607528.794799:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130101760 00000100:00100000:3.0:1789607528.794802:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130101760 00000100:00100000:0.0:1789607528.795152:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607528.795164:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+11:2394:x1876539130101504:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607528.795181:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607528.795200:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbd6ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687e3 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607528.795216:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607528.797117:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+10:2394:x1876539130101504:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1945us (13332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607528.797131:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1789607528.797620:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1789607528.797643:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+9:2394:x1876539130101760:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607528.797657:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607528.797676:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580600/0xa26202d240fbd8aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6688a0 expref: 9 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607528.797691:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607528.797729:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:2394:x1876539130101760:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 101us (13755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607528.797765:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1789607528.798217:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607528.798279:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102016 00000100:00100000:3.0:1789607528.798287:0:6470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102016 00000100:00100000:3.0:1789607528.798337:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 253 00000100:00100000:3.0:1789607528.798345:0:6470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+6:2392:x1876539130102016:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:3.0:1789607528.798377:0:6470:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd6ff 00000020:00010000:3.0:1789607528.798385:0:6470:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d78f77e4000: total 0 00000100:00080000:3.0:1789607528.798390:0:6470:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607528.798409:0:6470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1789607528.799026:0:6470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2392:x1876539130102016:12345-192.168.203.25@tcp:39:umount.0 Request processed in 679us (807us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789607528.799034:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 253 00000020:00010000:3.0:1789607528.799058:0:6457:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d78f77e4000: total 0 00010000:00010000:3.0:1789607528.799063:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607528.799101:0:6457:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d78f77e4000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789607528.799128:0:6457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83500) 00010000:00010000:3.0:1789607528.799132:0:6457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607528.799139:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e400/0xa26202d240fbe65d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c4a expref: 4 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607528.799160:0:6457:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d78f77e4000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789607528.799171:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607528.799173:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607528.799175:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607528.799334:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130101632 00000100:00100000:0.0:1789607528.799340:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130101632 00000100:00100000:0.0:1789607528.799376:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1789607528.799384:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+8:2394:x1876539130101632:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607528.799407:0:7268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607528.799419:0:7268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052400/0xa26202d240fbd6f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668814 expref: 8 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607528.799429:0:7268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607528.799459:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+7:2394:x1876539130101632:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 76us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607528.799466:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00080000:2.0:1789607528.799991:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607528.817986:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607528.818135:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102144 00000100:00100000:0.0:1789607528.818146:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102144 00000100:00100000:0.0:1789607528.818224:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 254 00000100:00100000:0.0:1789607528.818249:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+5:2392:x1876539130102144:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:0.0:1789607528.818289:0:12196:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd706 00000100:00080000:0.0:1789607528.818298:0:12196:0:(import.c:65:import_set_state_nolock()) ffff8d78fd166000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607528.818326:0:12196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789607528.818528:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ca3bd199-483e-4cd5-beca-47c622e32e26+3:2392:x1876539130102144:12345-192.168.203.25@tcp:39:umount.0 Request processed in 293us (549us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789607528.818536:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 254 00010000:00010000:3.0:1789607528.818763:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607528.819212:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607528.859642:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607528.859801:0:6463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102400 00000100:00100000:3.0:1789607528.859821:0:6463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102400 00000100:00100000:3.0:1789607528.859913:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 395 00000100:00100000:3.0:1789607528.859924:0:6463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+7:2392:x1876539130102400:12345-192.168.203.25@tcp:251:umount.0 00000020:00000080:3.0:1789607528.859979:0:6463:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5c4 00000020:00010000:3.0:1789607528.859987:0:6463:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d77c551c000: total 0 00000100:00080000:3.0:1789607528.859992:0:6463:0:(import.c:65:import_set_state_nolock()) ffff8d77c551e000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789607528.860070:0:6463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b814cb5b-bf81-4b03-a60b-45a9a573a4b8+3:2392:x1876539130102400:12345-192.168.203.25@tcp:251:umount.0 Request processed in 148us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607528.860077:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 395 00000020:00010000:2.0:1789607528.860507:0:6458:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d77c551c000: total 0 00010000:00010000:2.0:1789607528.860554:0:6458:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d77c551c000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789607528.860595:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbd69d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e6687d5 expref: 2 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607528.860610:0:6458:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d77c551c000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789607528.860619:0:6458:0:(genops.c:885:class_export_put()) final put ffff8d77c551c000/b814cb5b-bf81-4b03-a60b-45a9a573a4b8 00010000:00010000:2.0:1789607528.860652:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607528.860662:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607528.860664:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607528.860940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c551c000/b814cb5b-bf81-4b03-a60b-45a9a573a4b8 for MGS 00000020:00000080:1.0:1789607528.860982:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c551e000 for MGS 00000100:00100000:2.0:1789607529.186778:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607529.186800:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150074240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607529.186908:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607529.187009:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074240 00000100:00100000:1.0:1789607529.187018:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074240 00000100:00100000:1.0:1789607529.187066:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789607529.187075:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150074240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607529.187111:0:6474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607529.187163:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150074240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607529.187171:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789607529.187213:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150074240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607529.700700:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789607530.429249:0:14764:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789607530.456144:0:14764:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789607530.456192:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.456207:0:14764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.456215:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.456234:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.456258:0:14764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789607530.456264:0:14764:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789607530.456286:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1789607530.456286:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607530.456290:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789607530.456293:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607530.456296:0:14764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789607530.456301:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607530.456304:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.456312:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607530.456319:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607530.456319:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d78faccc800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1789607530.456324:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607530.456326:0:7735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789607530.456329:0:7735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789607530.456354:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.456360:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607530.456391:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.456405:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052000/0xa26202d240fbd66c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd673 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.456417:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.456419:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.456421:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607530.456463:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150074368:0@lo:39:umount.0 00000100:00100000:1.0:1789607530.456525:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607530.456637:0:7709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074368 00000100:00100000:3.0:1789607530.456645:0:7709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074368 00000100:00100000:3.0:1789607530.456700:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789607530.456708:0:7709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3467:x1876539150074368:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789607530.456732:0:7709:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd1db 00000100:00080000:3.0:1789607530.456739:0:7709:0:(import.c:65:import_set_state_nolock()) ffff8d78f05bc800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789607530.456797:0:7709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3467:x1876539150074368:12345-0@lo:39:umount.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607530.456805:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000020:00000080:3.0:1789607530.456814:0:7709:0:(genops.c:885:class_export_put()) final put ffff8d78f05be800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1789607530.456853:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78faccc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789607530.456892:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150074368:0@lo:39:umount.0 00000100:00100000:0.0:1789607530.457044:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607530.457056:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150074496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607530.457089:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607530.457240:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074496 00000100:00100000:1.0:1789607530.457245:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074496 00000100:00100000:1.0:1789607530.457291:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607530.457298:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150074496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607530.457320:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607530.457336:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbd673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd66c expref: 24 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607530.457349:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607530.457376:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+23:3471:x1876539150074496:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607530.457382:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607530.457470:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150074496:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789607530.457492:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607530.457495:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789607530.457499:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789607530.458731:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458747:0:14764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458755:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458761:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458958:0:14764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607530.458967:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458974:0:14764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458981:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.458987:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459547:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607530.459556:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459564:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607530.459569:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459578:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607530.459595:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607530.459602:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607530.459604:0:6457:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789607530.459648:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459655:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789607530.459710:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150074624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607530.459774:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607530.459840:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459848:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59d200/0xa26202d240fbd67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd681 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459876:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607530.459881:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459886:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fa00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607530.459889:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459896:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607530.459902:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607530.459907:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607530.459915:0:6457:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789607530.459930:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459936:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607530.459953:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.459960:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.459962:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.459964:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607530.459974:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150074752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607530.460001:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607530.460042:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074624 00000100:00100000:3.0:1789607530.460048:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074624 00000100:00100000:3.0:1789607530.460087:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074752 00000100:00100000:3.0:1789607530.460090:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074752 00000100:00100000:3.0:1789607530.460640:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607530.460652:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+24:3471:x1876539150074624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607530.460667:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607530.460682:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d000/0xa26202d240fbd681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd67a expref: 24 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.460695:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607530.460806:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+23:3471:x1876539150074624:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607530.460814:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607530.460832:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607530.460838:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+22:3468:x1876539150074752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607530.460857:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607530.460884:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbd585 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd57e expref: 22 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.460894:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607530.460924:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+21:3468:x1876539150074752:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607530.460930:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607530.460971:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150074752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607530.461307:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607530.461320:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f05be800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789607530.461371:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f05bc800 for lustre-MDT0000 00010000:00010000:0.0:1789607530.462549:0:14764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607530.462559:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbd57e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd585 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607530.462574:0:14764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789607530.462584:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.462592:0:14764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.462599:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.462606:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.462665:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607530.462672:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.462679:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581c00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607530.462682:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.462690:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607530.462698:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607530.462704:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789607530.462706:0:7735:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789607530.462738:0:7735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.462744:0:7735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607530.462784:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.462792:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.462794:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.462795:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607530.462803:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607530.462819:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150074880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607530.462894:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607530.462942:0:6455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150074880 00000100:00100000:3.0:1789607530.462949:0:6455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150074880 00000100:00100000:3.0:1789607530.462989:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607530.462997:0:6455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+21:3468:x1876539150074880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607530.463008:0:6455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607530.463019:0:6455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbd8e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd8db expref: 21 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.463030:0:6455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607530.463063:0:6455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0415db0-4674-4bfe-9696-a490439e72d4+20:3468:x1876539150074880:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607530.463070:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607530.463513:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150074624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607530.463594:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150074880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607530.463685:0:14764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607530.463692:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd581c00/0xa26202d240fbd8db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd8e2 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607530.463704:0:14764:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789607530.463712:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.463719:0:14764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.463726:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607530.463734:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.463763:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607530.463769:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.463776:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607530.463779:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.463799:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607530.463805:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607530.463810:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607530.463813:0:6457:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1789607530.463832:0:6457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.463838:0:6457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607530.463889:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.463899:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.463901:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.463903:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607530.463960:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150075008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607530.464001:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607530.464240:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075008 00000100:00100000:3.0:1789607530.464247:0:6456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075008 00000100:00100000:3.0:1789607530.464291:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607530.464299:0:6456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c2f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+20:3470:x1876539150075008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607530.464312:0:6456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607530.464323:0:6456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052e00/0xa26202d240fbd141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbd13a expref: 20 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607530.464335:0:6456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607530.464465:0:6456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c2f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3470:x1876539150075008:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607530.464481:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789607530.464594:0:14764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607530.464600:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c0030400/0xa26202d240fbd13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd141 expref: -99 pid: 6450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607530.464612:0:14764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1789607530.464615:0:14764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789607530.464618:0:14764:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789607530.464654:0:14764:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789607530.464658:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789607530.464662:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607530.464668:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:0.0:1789607530.464673:0:14764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d78e0099800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607530.464685:0:14764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d77c419a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607530.464690:0:14764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d78fd2de000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607530.464694:0:14764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d78ef671000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1789607530.464701:0:14764:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d78f77e4000 ca3bd199-483e-4cd5-beca-47c622e32e26 192.168.203.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607530.464706:0:14764:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d78e06a8000) has exports, disconnecting them 00000020:00080000:0.0:1789607530.464711:0:14764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d78e0099800), last request at 1789607526 00000020:00000080:0.0:1789607530.464717:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd4eb 00000100:00080000:0.0:1789607530.464733:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789607530.464774:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150075008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607530.464811:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607530.465062:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789607530.465095:0:14764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78e0099800): rc 0 00000020:00000080:1.0:1789607530.465097:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78e0099800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789607530.465277:0:14764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d77c419a800), last request at 1789607526 00000020:00000080:1.0:1789607530.465282:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd3cc 00000100:00080000:1.0:1789607530.465287:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d77c419e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789607530.465302:0:14764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c419a800): rc 0 00000020:00000080:1.0:1789607530.465304:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d77c419a800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1789607530.465323:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607530.465342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e0099800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789607530.465385:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78e0099000 for lustre-MDT0000 00000020:00080000:1.0:1789607530.465485:0:14764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d78fd2de000), last request at 1789607293 00000020:00000080:1.0:1789607530.465489:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd2c2 00000100:00080000:1.0:1789607530.465493:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d78fd2d9800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789607530.465525:0:14764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78fd2de000): rc 0 00000020:00000080:1.0:1789607530.465527:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78fd2de000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789607530.465544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789607530.465579:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c419e800 for lustre-MDT0000 00010000:00010000:2.0:1789607530.465599:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789607530.465666:0:14764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d78ef671000), last request at 1789607293 00000020:00000080:1.0:1789607530.465671:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd291 00000100:00080000:1.0:1789607530.465681:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d78ef677000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607530.465714:0:14764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789607530.465822:0:14764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78ef671000): rc 0 00000004:00000080:1.0:1789607530.465827:0:14764:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa81b03c37ae0 00000100:00080000:1.0:1789607530.465844:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789607530.465848:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789607530.466931:0:14764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789607530.466957:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d7901027800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789607530.467088:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150075136:0@lo:39:umount.0 00000100:00100000:2.0:1789607530.467335:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607530.467414:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075136 00000100:00100000:1.0:1789607530.467421:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075136 00000020:00000080:0.0:1789607530.467522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd2de000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789607530.467580:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fd2d9800 for lustre-MDT0000 00000100:00100000:1.0:1789607530.467613:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789607530.467630:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3467:x1876539150075136:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789607530.467653:0:6473:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd31d 00000100:00080000:1.0:1789607530.467660:0:6473:0:(import.c:65:import_set_state_nolock()) ffff8d78fd2dc800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789607530.467702:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607530.467922:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789607530.467926:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1789607530.467938:0:14764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789607530.468001:0:14764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789607530.468013:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d77c4446000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789607530.468024:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789607530.468026:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1789607530.468033:0:14764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789607530.468096:0:14764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789607530.468101:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789607530.468139:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d78e06a8000) has no exports 00000001:00000004:1.0:1789607530.468388:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789607530.468553:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3467:x1876539150075136:12345-0@lo:39:umount.0 Request processed in 930us (1217us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789607530.468560:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789607530.468668:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150075264:0@lo:9:umount.0 00000100:00100000:2.0:1789607530.468703:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607530.468734:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150075392:0@lo:9:umount.0 00000100:00100000:2.0:1789607530.468756:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607530.468792:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7901027800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789607530.468798:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150075136:0@lo:39:umount.0 00000100:00100000:2.0:1789607530.468819:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075264 00000100:00100000:2.0:1789607530.468824:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075264 00000100:00100000:2.0:1789607530.468880:0:13082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075392 00000100:00100000:2.0:1789607530.468883:0:13082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075392 00000100:00100000:2.0:1789607530.468907:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789607530.468929:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3467:x1876539150075264:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789607530.468948:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd46d 00000100:00080000:2.0:1789607530.468955:0:13082:0:(import.c:65:import_set_state_nolock()) ffff8d77c4445800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789607530.469007:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789607530.469016:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3467:x1876539150075392:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789607530.469030:0:8113:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5af 00000100:00080000:0.0:1789607530.469036:0:8113:0:(import.c:65:import_set_state_nolock()) ffff8d77c5519000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789607530.469264:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789607530.469534:0:13082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789607530.469842:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3467:x1876539150075264:12345-0@lo:9:umount.0 Request processed in 913us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607530.469850:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789607530.469897:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607530.469901:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789607530.469998:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607530.470071:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4446000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789607530.470080:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789607530.470082:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607530.470086:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150075264:0@lo:9:umount.0 00000001:00000004:0.0:1789607530.470446:0:8113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789607530.470716:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3467:x1876539150075392:12345-0@lo:9:umount.0 Request processed in 1701us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607530.470724:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789607530.471005:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789607530.471016:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789607530.471018:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607530.471022:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150075392:0@lo:9:umount.0 00010000:00010000:3.0:1789607530.471418:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789607530.478938:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d78e06a8000) has no exports 00000020:00000080:0.0:1789607530.546746:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd195 00000020:00000080:0.0:1789607530.546761:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d7900371800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789607530.546779:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789607530.546937:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7900371800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789607530.549388:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607530.549403:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789607530.549421:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d78f768cd40) has no exports 00000020:00000080:1.0:1789607530.549814:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd18e 00000020:00000080:1.0:1789607530.549822:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78f7697800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789607530.549920:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607530.549927:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789607530.549931:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78ef603800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789607530.549933:0:14764:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78ef603800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789607530.549943:0:14764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789607530.550133:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f7697800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789607530.723101:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607531.234435:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150075520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607531.234507:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607531.234584:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075520 00000100:00100000:1.0:1789607531.234592:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075520 00000100:00100000:1.0:1789607531.234659:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789607531.234668:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150075520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607531.234701:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607531.234743:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150075520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607531.234750:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789607531.234791:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150075520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607531.235118:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150075904:0@lo:400:kworker.0 00000100:00100000:3.0:1789607531.235151:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607531.235175:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150076416:0@lo:400:kworker.0 00000100:00100000:3.0:1789607531.235194:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607531.235211:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789607531.235216:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150076032:0@lo:400:kworker.0 00000100:00100000:3.0:1789607531.235250:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607531.235265:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150076544:0@lo:400:kworker.0 00000100:00100000:3.0:1789607531.235283:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607531.235308:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075904 00000100:00100000:3.0:1789607531.235312:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075904 00000100:00100000:3.0:1789607531.235336:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076416 00000100:00100000:3.0:1789607531.235339:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076416 00000100:00100000:3.0:1789607531.235347:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076032 00000100:00100000:3.0:1789607531.235349:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076032 00000100:00100000:3.0:1789607531.235370:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076544 00000100:00100000:3.0:1789607531.235373:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076544 00000100:00100000:3.0:1789607531.235391:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789607531.235398:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150076544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607531.235436:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150076544:12345-0@lo:400:kworker.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607531.235442:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789607531.235456:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789607531.235460:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150075904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789607531.235464:0:6468:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789607531.235487:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150075904:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789607531.235492:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789607531.235503:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789607531.235506:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150076416:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789607531.235510:0:6468:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789607531.235528:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150076416:12345-0@lo:400:kworker.0 Request processed in 21us (333us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789607531.235534:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789607531.235545:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789607531.235548:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150076032:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789607531.235552:0:6468:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789607531.235572:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150076032:12345-0@lo:400:kworker.0 Request processed in 22us (321us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789607531.235577:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1789607531.235605:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789607531.235610:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789607531.235630:0:3470:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789607531.235989:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607531.235995:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607531.236244:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150075648:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236281:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607531.236311:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150076160:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236333:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607531.236352:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789607531.236357:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150075776:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236378:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607531.236394:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150076288:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236414:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607531.236442:0:6464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075648 00000100:00100000:2.0:1789607531.236447:0:6464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075648 00000100:00100000:2.0:1789607531.236477:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789607531.236484:0:6464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3468:x1876539150075648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236521:0:6464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f84b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0415db0-4674-4bfe-9696-a490439e72d4+19:3468:x1876539150075648:12345-0@lo:400:kworker.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607531.236527:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789607531.236552:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150075776 00000100:00100000:2.0:1789607531.236563:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150075776 00000100:00100000:2.0:1789607531.236587:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789607531.236591:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3468:x1876539150075776:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789607531.236597:0:8480:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789607531.236632:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3468:x1876539150075776:12345-0@lo:400:kworker.0 Request processed in 39us (253us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789607531.236638:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789607531.236655:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076288 00000100:00100000:2.0:1789607531.236659:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076288 00000100:00100000:2.0:1789607531.236686:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789607531.236691:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150076288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236719:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150076288:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607531.236724:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1789607531.236761:0:3468:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789607531.236764:0:3468:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789607531.236767:0:3468:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789607531.236773:0:3468:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607531.236777:0:3468:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:2.0:1789607531.236786:0:3468:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d78fd189800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607531.236809:0:3468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d77c4412a00 x1876539150076672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607531.236830:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150075776:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236843:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150076288:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236850:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150075648:0@lo:400:kworker.0 00000100:00100000:2.0:1789607531.236904:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150076672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789607531.236928:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607531.236954:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076672 00000100:00100000:2.0:1789607531.236958:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076672 00000100:00100000:2.0:1789607531.236976:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789607531.236980:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150076672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789607531.236993:0:6473:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1789607531.237054:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607531.237104:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076160 00000100:00100000:0.0:1789607531.237109:0:6468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076160 00000100:00100000:0.0:1789607531.237142:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789607531.237148:0:6468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150076160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607531.237188:0:6468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150076160:12345-0@lo:400:kworker.0 Request processed in 41us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607531.237194:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1789607531.237209:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789607531.239671:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcb7d880 x1876539150076160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607531.239689:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150076160:0@lo:400:kworker.0 00000100:00080000:3.0:1789607531.261459:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607531.261469:0:3470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 215 00000100:00080000:3.0:1789607531.261483:0:3470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d7901feb800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607531.261517:0:3470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0701500 x1876539150076800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607531.261553:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150076032:0@lo:400:kworker.0 00010000:00080000:3.0:1789607531.261582:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f0703480 x1876539150076544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607531.261593:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150076544:0@lo:400:kworker.0 00000100:00080000:3.0:1789607531.261604:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789607531.261608:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d78e009d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789607531.261611:0:3470:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789607531.261625:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d78e009d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607531.261629:0:3470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:3.0:1789607531.261634:0:3470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d78e009d000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607531.261647:0:3470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0703100 x1876539150076928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607531.261657:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150075904:0@lo:400:kworker.0 00000100:00080000:3.0:1789607531.261671:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789607531.261674:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789607531.261676:0:3470:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789607531.261691:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607531.261695:0:3470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 237 00000100:00080000:3.0:1789607531.261700:0:3470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78f77e6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607531.261713:0:3470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0700380 x1876539150077056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607531.261724:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150076416:0@lo:400:kworker.0 00000100:00100000:1.0:1789607531.266546:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150076800:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789607531.266629:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607531.266672:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150076928:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789607531.266695:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607531.266714:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150077056:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789607531.266736:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607531.266775:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076800 00000100:00100000:1.0:1789607531.266814:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076800 00000100:00100000:1.0:1789607531.266849:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150076928 00000100:00100000:1.0:1789607531.266852:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150076928 00000100:00100000:1.0:1789607531.266884:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077056 00000100:00100000:1.0:1789607531.266887:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077056 00000100:00100000:1.0:1789607531.266901:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789607531.266908:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150076800:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789607531.266925:0:6469:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789607531.266968:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150076800:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 60us (340us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607531.266988:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789607531.267005:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789607531.267009:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150076928:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789607531.267016:0:6469:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789607531.267041:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150076928:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (345us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607531.267047:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789607531.267057:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789607531.267061:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150077056:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789607531.267067:0:6469:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789607531.267088:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150077056:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26us (351us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607531.267093:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1789607531.267356:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607531.267362:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789607531.267365:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150076800:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789607531.267374:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e009d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607531.267384:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789607531.267387:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150076928:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789607531.267398:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607531.267401:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789607531.267403:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150077056:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789607531.283545:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150076672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 46556us (46607us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607531.283559:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1789607531.287552:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607531.287564:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789607531.287569:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150076672:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:2.0:1789607531.311411:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00000001:00080000:2.0:1789607531.311429:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789607531.311434:0:7270:0:(genops.c:885:class_export_put()) final put ffff8d78f77e5000/ca3bd199-483e-4cd5-beca-47c622e32e26 00000001:00100000:2.0:1789607531.311455:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000001:00080000:2.0:1789607531.311460:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789607531.311462:0:7270:0:(genops.c:885:class_export_put()) final put ffff8d77c551b000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 00000001:00100000:2.0:1789607531.311469:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789607531.311473:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789607531.311475:0:7270:0:(genops.c:885:class_export_put()) final put ffff8d78ef670000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607531.311521:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e5000/ca3bd199-483e-4cd5-beca-47c622e32e26 for lustre-MDT0001 00000020:00000080:1.0:1789607531.317012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c551b000/9e7ed4b5-4de4-49ed-8b20-6246d0400cc8 for lustre-MDT0001 00000020:00000080:0.0:1789607531.331402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78ef670000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789607531.331477:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fd166000 for lustre-MDT0001 00000020:00000080:0.0:1789607531.331485:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f77e5800 for lustre-MDT0001 00000020:00000080:0.0:1789607531.331488:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fd2dc800 for lustre-MDT0001 00010000:00010000:3.0:1789607531.746139:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607531.812717:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607531.812726:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d77c551f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607531.812752:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c551f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789607531.812794:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c5519000 for lustre-OST0001 00000001:00100000:2.0:1789607531.835001:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607531.835011:0:6490:0:(genops.c:885:class_export_put()) final put ffff8d78ef671000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789607531.835035:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca3bd199-483e-4cd5-beca-47c622e32e26 00000001:00080000:2.0:1789607531.835043:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789607531.835061:0:6490:0:(genops.c:885:class_export_put()) final put ffff8d78f77e4000/ca3bd199-483e-4cd5-beca-47c622e32e26 00000020:00000080:0.0:1789607531.835113:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78ef671000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789607531.835173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e4000/ca3bd199-483e-4cd5-beca-47c622e32e26 for lustre-MDT0000 00000020:00000080:0.0:1789607531.835200:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78ef677000 for lustre-MDT0000 00000020:00000080:0.0:1789607531.835212:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f77e7000 for lustre-MDT0000 00000001:00100000:1.0:1789607532.285346:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607532.285356:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d77c4442000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607532.285380:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4442000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789607532.285425:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4445800 for lustre-OST0000 00000020:01000000:1.0:1789607532.578013:0:14764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d77c66434e0 - data ffff8d78fbdd2360/ffff8d77c414c800 00000020:01000000:1.0:1789607532.578144:0:14764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78f8583d80 - data ffff8d78f15846c0/ffff8d78c7b8e000 00000001:00000004:1.0:1789607532.585348:0:14764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789607532.677856:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789607532.678036:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789607532.678050:0:14764:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d78fd114000 x1876539150075136/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789607540 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607532.678076:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789607532.687194:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789607532.687202:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1789607532.687221:0:14764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607532.687223:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789607532.688074:0:8478:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789607532.688080:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789607532.688091:0:8478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789607532.689287:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789607532.689293:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789607532.689311:0:14764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607532.689313:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789607532.689560:0:9399:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789607532.689565:0:9399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789607532.689572:0:9399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789607532.755467:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd15d 00000020:00000080:3.0:1789607532.755478:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78f567e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789607532.756890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f567e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789607532.757308:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd172 00000020:00000080:3.0:1789607532.757318:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78faccc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607532.757364:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789607532.757370:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607532.757379:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789607532.757384:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d78e06ab380) has no exports 00000004:01000000:3.0:1789607532.757538:0:14764:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789607532.757546:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5a8 00000020:00000080:3.0:1789607532.757551:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d77c551d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607532.758189:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faccc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789607532.758295:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789607532.758309:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607532.758320:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789607532.758323:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8d78f12b4d40) has no exports 00000020:00000080:3.0:1789607532.758330:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd5a1 00000020:00000080:3.0:1789607532.758336:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78f77e2800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789607532.758686:0:14764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789607532.758691:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789607532.758695:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789607532.758701:0:14764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607532.758703:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789607532.758732:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607532.758740:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607532.758745:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd466 00000020:00000080:3.0:1789607532.758749:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d77c4443000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607532.758753:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789607532.758756:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607532.758760:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789607532.758762:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8d77c45519c0) has no exports 00000020:00000080:3.0:1789607532.758767:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd45f 00000020:00000080:3.0:1789607532.758770:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d77c4444000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789607532.759191:0:14764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789607532.759195:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789607532.759198:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789607532.759201:0:14764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607532.759202:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789607532.759228:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607532.759234:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789607532.759245:0:14764:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789607532.759251:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd316 00000020:00000080:3.0:1789607532.759256:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d7901026800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607532.759259:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789607532.759263:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607532.759274:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789607532.759276:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d78f768b380) has no exports 00000020:00000080:3.0:1789607532.759280:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd30f 00000020:00000080:3.0:1789607532.759283:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d7901020800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789607532.760760:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c551d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789607532.760779:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789607532.760795:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f77e3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789607532.760812:0:8:0:(genops.c:885:class_export_put()) final put ffff8d77c4ba6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607532.760815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4ba6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789607532.760819:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607532.760907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4443000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789607532.760912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4444000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789607532.760917:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4446000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789607532.760920:0:8:0:(genops.c:885:class_export_put()) final put ffff8d77c4442800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607532.760922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4442800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789607532.760925:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607532.761108:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7901026800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789607532.761114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7901020800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789607532.764088:0:14764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789607532.764098:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789607532.764102:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789607532.764112:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607532.764168:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607532.764181:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607532.764208:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607532.764212:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607532.764217:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78f567a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607532.764221:0:14764:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f567a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789607532.764228:0:14764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607532.764315:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd179 00000020:00000080:0.0:1789607532.764322:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78facce000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789607532.764327:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789607532.764332:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607532.764336:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789607532.764340:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d78e06acd40) has no exports 00000020:00000080:0.0:1789607532.764365:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607532.764369:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789607532.764373:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd180 00000020:00000080:0.0:1789607532.764377:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78facc9800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789607532.764385:0:14764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78c75d7000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789607532.764388:0:14764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c75d7000 3 00000020:01000004:0.0:1789607532.764390:0:14764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78c75d7000 from lustre-MDT0000 00000020:00000080:0.0:1789607532.764418:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607532.764423:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789607532.764425:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78f5679800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789607532.764428:0:14764:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5679800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789607532.764434:0:14764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789607532.764462:0:14764:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789607532.764466:0:14764:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789607532.764469:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789607532.764471:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607532.764474:0:14764:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789607532.764480:0:14764:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d78d9364800 c0415db0-4674-4bfe-9696-a490439e72d4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607532.764485:0:14764:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d78f05b19c0) has exports, disconnecting them 00000020:00080000:0.0:1789607532.764489:0:14764:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d78d9364800), last request at 1789607274 00000020:00000080:0.0:1789607532.764504:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd11e 00000020:00010000:0.0:1789607532.764507:0:14764:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d78d9364800: total 2 00000100:00080000:0.0:1789607532.764511:0:14764:0:(import.c:65:import_set_state_nolock()) ffff8d78d9365000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789607532.764524:0:14764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78d9364800): rc 0 00000020:00080000:0.0:1789607532.764527:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d78f05b19c0) has no exports 00000100:00100000:0.0:1789607532.764585:0:6462:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d78e0bd5800:6462] 0 exiting: rc = 1 00000020:00000080:1.0:1789607532.764699:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d7901027800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789607532.764706:0:8:0:(genops.c:885:class_export_put()) final put ffff8d7901020000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607532.764708:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7901020000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789607532.764713:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607532.764759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78facce000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789607532.764763:0:8:0:(genops.c:885:class_export_put()) final put ffff8d78f5678000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789607532.764765:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5678000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789607532.764768:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789607532.764809:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78facc9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1789607532.765234:0:6464:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d78d933a200:6464] 2 exiting: rc = 0 00000100:00100000:2.0:1789607532.765331:0:6463:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d78e0bd5c00:6463] 1 exiting: rc = 0 00000100:00100000:0.0:1789607532.765711:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765720:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765727:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765732:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765738:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765744:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765749:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765755:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765760:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765766:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765772:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765778:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765794:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765810:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765815:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765821:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765827:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765833:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765841:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765847:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765852:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.765858:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766107:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766112:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766118:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766123:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766128:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766134:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766139:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766144:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766149:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766154:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766160:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766166:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766171:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766177:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766182:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766187:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766192:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766198:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766203:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766209:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766213:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766218:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766222:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766228:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766233:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766238:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766252:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766257:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766263:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766268:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766273:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766278:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766284:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766289:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766294:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766299:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766305:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766310:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766316:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766322:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766326:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607532.766331:0:14764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789607532.766848:0:14764:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789607532.766852:0:14764:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1789607532.767663:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d79021da200/0xa26202d240fbd21a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd213 expref: 14 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767686:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021da200/0xa26202d240fbd21a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd213 expref: 14 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767717:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbd61f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd618 expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767728:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbd61f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd618 expref: 13 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767737:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbd62d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd626 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767745:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbd62d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd626 expref: 12 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767753:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d7902052200/0xa26202d240fbd63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd634 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767761:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7902052200/0xa26202d240fbd63b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd634 expref: 11 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767768:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78e075de00/0xa26202d240fbd649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd642 expref: 10 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767775:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075de00/0xa26202d240fbd649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd642 expref: 10 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767850:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78e075d400/0xa26202d240fbd657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd650 expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767883:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d400/0xa26202d240fbd657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd650 expref: 9 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767903:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd65e expref: 8 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767912:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d600/0xa26202d240fbd665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd65e expref: 8 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767920:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd68f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd688 expref: 7 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767928:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbd68f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd688 expref: 7 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.767939:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd538 expref: 6 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768075:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0031000/0xa26202d240fbd53f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd538 expref: 6 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768090:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d79021da800/0xa26202d240fbd228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd221 expref: 5 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768099:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79021da800/0xa26202d240fbd228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd221 expref: 5 pid: 6463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768110:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd580800/0xa26202d240fbd8b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd8b1 expref: 4 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768118:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580800/0xa26202d240fbd8b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd8b1 expref: 4 pid: 6462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768135:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbd8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd8bf expref: 3 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768143:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbd8c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd8bf expref: 3 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768151:0:14764:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd580200/0xa26202d240fbd8d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbd8cd expref: 2 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607532.768158:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580200/0xa26202d240fbd8d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbd8cd expref: 2 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1789607532.769027:0:7735:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d78d9364800: total 0 00010000:00010000:0.0:1789607532.769074:0:7735:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d78d9364800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789607532.769087:0:7735:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d78d9364800, canceled 0 locks, left on hash table 0. 00000020:00000080:0.0:1789607532.769094:0:7735:0:(genops.c:885:class_export_put()) final put ffff8d78d9364800/c0415db0-4674-4bfe-9696-a490439e72d4 00010000:00010000:0.0:1789607532.769108:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607532.769110:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607532.769111:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607532.769743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d9364800/c0415db0-4674-4bfe-9696-a490439e72d4 for MGS 00000020:00000080:1.0:1789607532.769798:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78d9365000 for MGS 00010000:00010000:3.0:1789607532.782502:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607533.282382:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150077184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607533.282454:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607533.283243:0:8116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077184 00000100:00100000:2.0:1789607533.283254:0:8116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077184 00000100:00100000:2.0:1789607533.283324:0:8116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789607533.283334:0:8116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150077184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607533.283367:0:8116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607533.283427:0:8116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150077184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607533.283434:0:8116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789607533.283614:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150077184:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789607533.283775:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789607533.794021:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789607534.818100:0:14764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78c30e18a0 - data ffff8d78cf29e360/ffff8d78fab34400 00000020:01000000:1.0:1789607534.818254:0:14764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78c7bbd780 - data ffff8d78f16d9288/ffff8d78e075a800 00010000:00010000:0.0:1789607534.818749:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607534.821185:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd102 00000020:00000080:1.0:1789607534.821195:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78f05bd000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789607534.821694:0:14764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78c75d7000 from MGS, refs=2 00000020:01000004:1.0:1789607534.821700:0:14764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c75d7000 2 00000020:01000004:1.0:1789607534.821703:0:14764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78c75d7000 from MGS 00000020:00000080:1.0:1789607534.821726:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607534.821734:0:14764:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789607534.821737:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78c75d4000/MGS 00000020:00000080:1.0:1789607534.821740:0:14764:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c75d4000/MGS for MGS 00000020:01000000:1.0:1789607534.821747:0:14764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789607534.821822:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789607534.821829:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607534.821849:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789607534.821856:0:14764:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d78faccb800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789607534.821889:0:14764:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8d78f12b3380) has exports, disconnecting them 00000020:00080000:1.0:1789607534.821894:0:14764:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d78faccb800), last request at 1789607275 00000020:00000080:1.0:1789607534.821898:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd1cd 00000020:00080000:1.0:1789607534.821909:0:14764:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78faccb800): rc 0 00000020:00000080:1.0:1789607534.821914:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78faccb800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789607534.824365:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f05bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789607534.829072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faccb800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789607534.829121:0:14764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789607534.829126:0:14764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607534.829131:0:14764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607534.829150:0:14764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607534.829344:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607534.829353:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789607534.829359:0:14764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c75d7000 1 00000020:00000080:0.0:1789607534.829365:0:14764:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd0f4 00000020:00000080:0.0:1789607534.829373:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78e0a1b800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789607534.829378:0:14764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789607534.829382:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607534.829386:0:14764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789607534.829389:0:14764:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d78e06a99c0) has no exports 00000020:00000080:2.0:1789607534.830633:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78faccc800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789607534.830643:0:36:0:(genops.c:885:class_export_put()) final put ffff8d78faccd800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789607534.830646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faccd800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789607534.830655:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789607534.830718:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e0a1b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789607534.947013:0:14764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607534.947027:0:14764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789607534.947034:0:14764:0:(genops.c:885:class_export_put()) final put ffff8d78c75d5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789607534.947039:0:14764:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c75d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789607534.947054:0:14764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789607534.947266:0:14764:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d78c75d5800 00000020:02000400:2.0:1789607534.947347:0:14764:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789607535.841992:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607536.358615:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150077312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607536.358688:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607536.359055:0:9818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077312 00000100:00100000:3.0:1789607536.359063:0:9818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077312 00000100:00100000:3.0:1789607536.359118:0:9818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789607536.359127:0:9818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150077312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607536.359161:0:9818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607536.359205:0:9818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150077312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607536.359212:0:9818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1789607536.359232:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607536.359423:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150077312:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789607536.360849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607536.360855:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607536.360871:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607536.360878:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1789607536.360883:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607536.360892:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d78fd189800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607536.360911:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd82a00 x1876539150077568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607536.360928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607536.360932:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607536.360933:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78e009d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607536.360937:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1789607536.360940:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607536.360944:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d78e009d000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607536.360953:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd81c00 x1876539150077696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607536.360962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607536.360971:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607536.360974:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607536.360978:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1789607536.360981:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607536.360986:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d7901feb800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607536.360997:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd80380 x1876539150077824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607536.361026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607536.361029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607536.361031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607536.361034:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1789607536.361037:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607536.361040:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78f77e6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607536.361048:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd82680 x1876539150078208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607536.361413:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150077952:0@lo:400:kworker.0 00000100:00100000:1.0:1789607536.361468:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607536.361501:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607536.361506:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150077440:0@lo:400:kworker.0 00000400:00000100:1.0:1789607536.361522:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150077440 offset 0 length 224: 4 00000100:00100000:1.0:1789607536.361549:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077952 00000100:00100000:1.0:1789607536.361556:0:6469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077952 00000100:00100000:1.0:1789607536.361611:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789607536.361620:0:6469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150077952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607536.361662:0:6469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150077952:12345-0@lo:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607536.361669:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:1.0:1789607536.361687:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789607536.361711:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d78fcd80700 x1876539150077952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607536.361723:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150077952:0@lo:400:kworker.0 00000100:00100000:2.0:1789607536.361820:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150077568:0@lo:38:kworker.0 00000100:00100000:2.0:1789607536.361856:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607536.361935:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150077696:0@lo:38:kworker.0 00000100:00100000:2.0:1789607536.361959:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607536.361989:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150077824:0@lo:38:kworker.0 00000100:00100000:2.0:1789607536.362014:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607536.362029:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150078208:0@lo:38:kworker.0 00000100:00100000:2.0:1789607536.362047:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607536.362143:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077696 00000100:00100000:2.0:1789607536.362147:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077696 00000100:00100000:2.0:1789607536.362166:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077824 00000100:00100000:2.0:1789607536.362168:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077824 00000100:00100000:2.0:1789607536.362178:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078208 00000100:00100000:2.0:1789607536.362181:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078208 00000100:00100000:2.0:1789607536.362190:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789607536.362195:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3467:x1876539150077696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789607536.362213:0:12196:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607536.362250:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3467:x1876539150077696:12345-0@lo:38:kworker.0 Request processed in 54us (291us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607536.362257:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789607536.362270:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789607536.362274:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3467:x1876539150077824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789607536.362298:0:12196:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607536.362324:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3467:x1876539150077824:12345-0@lo:38:kworker.0 Request processed in 49us (309us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607536.362329:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789607536.362340:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789607536.362344:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3467:x1876539150078208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789607536.362352:0:12196:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607536.362373:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3467:x1876539150078208:12345-0@lo:38:kworker.0 Request processed in 28us (325us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607536.362385:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789607536.362414:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e009d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607536.362418:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789607536.362421:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150077696:0@lo:38:kworker.0 00000100:00080000:2.0:1789607536.362428:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607536.362431:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789607536.362434:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150077824:0@lo:38:kworker.0 00000100:00080000:2.0:1789607536.362441:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607536.362444:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789607536.362446:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150078208:0@lo:38:kworker.0 00000100:00100000:1.0:1789607536.363485:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150077568 00000100:00100000:1.0:1789607536.363493:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150077568 00000100:00100000:1.0:1789607536.364025:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789607536.364042:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150077568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789607536.364060:0:6474:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789607536.364122:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150077568:12345-0@lo:38:kworker.0 Request processed in 81us (2266us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607536.364129:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1789607536.364201:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607536.364206:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789607536.364210:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150077568:0@lo:38:kworker.0 00000100:00100000:2.0:1789607536.368187:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150078080:0@lo:400:kworker.0 00000100:00100000:2.0:1789607536.368273:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607536.368337:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607536.368357:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150078336:0@lo:400:kworker.0 00000100:00100000:2.0:1789607536.368385:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607536.368423:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078336 00000100:00100000:2.0:1789607536.368431:0:12196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078336 00000100:00100000:2.0:1789607536.368489:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789607536.368497:0:12196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150078336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607536.368548:0:12196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150078336:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607536.368570:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00080000:2.0:1789607536.368620:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d78fcd83100 x1876539150078336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607536.368635:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150078336:0@lo:400:kworker.0 00000100:00100000:0.0:1789607536.370522:0:9649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078080 00000100:00100000:0.0:1789607536.370537:0:9649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078080 00000100:00100000:0.0:1789607536.370622:0:9649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607536.370632:0:9649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150078080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607536.370722:0:9649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150078080:12345-0@lo:400:kworker.0 Request processed in 92us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607536.370729:0:9649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607536.370785:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150078080:0@lo:400:kworker.0 00000100:00080000:0.0:1789607536.371011:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607536.371017:0:6465:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789607536.868978:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607537.318565:0:13338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789607537.686291:0:14920:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789607537.709836:0:14920:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789607537.709948:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.709963:0:14920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.709970:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.709994:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710011:0:14920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789607537.710016:0:14920:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789607537.710043:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789607537.710047:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789607537.710053:0:14920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789607537.710058:0:14920:0:(import.c:65:import_set_state_nolock()) ffff8d78e009d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789607537.710063:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789607537.710064:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789607537.710067:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789607537.710908:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710920:0:14920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710926:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710933:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710953:0:14920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789607537.710958:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710977:0:14920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710983:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710988:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.710998:0:14920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789607537.711002:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711008:0:14920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711014:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711019:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711025:0:14920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789607537.711030:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711035:0:14920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711050:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711055:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607537.711061:0:14920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1789607537.711065:0:14920:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789607537.711084:0:14920:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789607537.711088:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789607537.711091:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607537.711097:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789607537.711104:0:14920:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8d77c4ba0800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789607537.711109:0:14920:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8d77c4436800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789607537.711114:0:14920:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8d78e9ee8000) has exports, disconnecting them 00000020:00080000:3.0:1789607537.711119:0:14920:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d77c4ba0800), last request at 1789607536 00000020:00000080:3.0:1789607537.711124:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd500 00000100:00080000:3.0:1789607537.711144:0:14920:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ba4800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789607537.711189:0:14920:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c4ba0800): rc 0 00000020:00000080:3.0:1789607537.711192:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d77c4ba0800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789607537.711202:0:14920:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d77c4436800), last request at 1789607536 00000020:00000080:3.0:1789607537.711205:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd3da 00000100:00080000:3.0:1789607537.711210:0:14920:0:(import.c:65:import_set_state_nolock()) ffff8d77c4432800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789607537.711222:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4ba0800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789607537.711275:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4ba4800 for lustre-MDT0001 00000020:00080000:3.0:1789607537.711290:0:14920:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c4436800): rc 0 00000020:00000080:3.0:1789607537.711292:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d77c4436800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789607537.711307:0:14920:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa81b01d4fae0 00000020:00000080:3.0:1789607537.711318:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4436800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789607537.711345:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4432800 for lustre-MDT0001 00000100:00080000:3.0:1789607537.711366:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789607537.711370:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789607537.712196:0:14920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789607537.712202:0:14920:0:(import.c:65:import_set_state_nolock()) ffff8d78fd189800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789607537.712335:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789607537.712339:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:3.0:1789607537.712349:0:14920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789607537.712403:0:14920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789607537.712426:0:14920:0:(import.c:65:import_set_state_nolock()) ffff8d77c3a5b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789607537.712440:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789607537.712442:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789607537.712451:0:14920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789607537.712518:0:14920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789607537.712527:0:14920:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ecc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789607537.712549:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d78e9ee8000) has no exports 00010000:00010000:2.0:1789607537.713720:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789607537.713731:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.713741:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607537.713745:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.713755:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607537.713762:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607537.713767:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607537.713769:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789607537.713772:0:6458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789607537.713804:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.713811:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607537.713831:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714020:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052600/0xa26202d240fbd650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd657 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714033:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789607537.714036:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714042:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607537.714045:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714052:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607537.714058:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607537.714063:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607537.714066:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1789607537.714068:0:6458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1789607537.714081:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714087:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607537.714093:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714099:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571e800/0xa26202d240fbd65e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd665 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714118:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607537.714121:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714127:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607537.714129:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714135:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607537.714141:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607537.714145:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607537.714147:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789607537.714149:0:6458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789607537.714160:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714165:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607537.714179:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714190:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075c000/0xa26202d240fbd538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd53f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714203:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607537.714207:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714217:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581a00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607537.714220:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714227:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607537.714233:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607537.714238:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789607537.714240:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789607537.714242:0:6458:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789607537.714255:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714261:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607537.714267:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714273:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd581a00/0xa26202d240fbd8cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd8d4 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714282:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607537.714285:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.714290:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79021db800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607537.714292:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607537.714392:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607537.714411:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150078976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607537.714475:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607537.714526:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607537.714532:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150079104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607537.714553:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607537.714603:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078976 00000100:00100000:0.0:1789607537.714609:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078976 00000100:00100000:0.0:1789607537.714642:0:6454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150079104 00000100:00100000:0.0:1789607537.714645:0:6454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150079104 00000100:00100000:0.0:1789607537.714662:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607537.714668:0:6454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3468:x1876539150078976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789607537.714674:0:6454:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607537 with bad export cookie 11700917883918602526 00010000:00010000:1.0:1789607537.715792:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607537.715818:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150078848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607537.715889:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607537.715928:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607537.715934:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150078720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607537.715954:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607537.716030:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607537.716038:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607537.716044:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607537.716047:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789607537.716050:0:6458:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789607537.716083:0:6458:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.716089:0:6458:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607537.716114:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.716121:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d79021db800/0xa26202d240fbd221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbd228 expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607537.716138:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607537.716140:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607537.716142:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607537.716165:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150078464:0@lo:9:umount.0 00000100:00100000:2.0:1789607537.716198:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607537.716223:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150078592:0@lo:9:umount.0 00000100:00100000:2.0:1789607537.716242:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607537.716335:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150079232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607537.716358:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607537.716405:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078464 00000100:00100000:2.0:1789607537.716412:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078464 00000100:00100000:2.0:1789607537.716451:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078592 00000100:00100000:2.0:1789607537.716453:0:8112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078592 00000100:00100000:2.0:1789607537.716474:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789607537.716482:0:8112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3467:x1876539150078464:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789607537.716506:0:8112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd427 00000100:00080000:2.0:1789607537.716515:0:8112:0:(import.c:65:import_set_state_nolock()) ffff8d77c3a5f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607537.716548:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789607537.717921:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078848 00000100:00100000:1.0:1789607537.717937:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078848 00000100:00100000:1.0:1789607537.717964:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150078720 00000100:00100000:1.0:1789607537.717968:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150078720 00000100:00100000:1.0:1789607537.717976:0:7268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150079232 00000100:00100000:1.0:1789607537.717978:0:7268:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150079232 00000100:00100000:1.0:1789607537.717992:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607537.717999:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3468:x1876539150079104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789607537.718007:0:7268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607537 with bad export cookie 11700917883918602526 00000100:00100000:1.0:1789607537.718087:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3468:x1876539150079104:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (3531us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607537.718093:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607537.718111:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607537.718114:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3471:x1876539150078848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789607537.718130:0:7268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607537 with bad export cookie 11700917883918602526 00000100:00100000:1.0:1789607537.718161:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3471:x1876539150078848:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (2272us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607537.718166:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607537.718179:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607537.718183:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3471:x1876539150078720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789607537.718187:0:7268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607537 with bad export cookie 11700917883918602526 00000100:00100000:1.0:1789607537.718210:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3471:x1876539150078720:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (2255us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607537.718216:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607537.718226:0:7268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789607537.718230:0:7268:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3470:x1876539150079232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789607537.718234:0:7268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607537 with bad export cookie 11700917883918602526 00000100:00100000:1.0:1789607537.718265:0:7268:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3470:x1876539150079232:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1906us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607537.718271:0:7268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789607537.718310:0:3471:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789607537.718315:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789607537.718319:0:3471:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1789607537.720880:0:13082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607537.720898:0:13082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3467:x1876539150078592:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789607537.720939:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd569 00000100:00080000:3.0:1789607537.720950:0:13082:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ba2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607537.720991:0:13082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789607537.722090:0:8112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3467:x1876539150078464:12345-0@lo:9:umount.0 Request processed in 5603us (5885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607537.722101:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789607537.722155:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789607537.723135:0:13082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3467:x1876539150078592:12345-0@lo:9:umount.0 Request processed in 2239us (6887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607537.723146:0:13082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789607537.736779:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c3a5b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789607537.736802:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789607537.736823:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607537.736830:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150078464:0@lo:9:umount.0 00000100:00080000:3.0:1789607537.736848:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4ecc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789607537.736858:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789607537.736874:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607537.736877:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150078592:0@lo:9:umount.0 00000100:00080000:1.0:1789607537.743641:0:3471:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.125@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789607537.743649:0:3471:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789607537.743660:0:3471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fcd82300 x1876539150077440/t0(0) o400->MGC192.168.203.125@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789607552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607537.743675:0:3471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fcb7ce00 x1876539150078976/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607553 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607537.743685:0:3471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fcb7e680 x1876539150079104/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607553 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607537.743715:0:3471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fcb7d880 x1876539150078848/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607553 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607537.743725:0:3471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fcb7ed80 x1876539150078720/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607553 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607537.743733:0:3471:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fd4ebb80 x1876539150079232/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607553 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789607537.743748:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789607537.743751:0:3471:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789607537.743752:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789607537.743836:0:3470:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d78c2eb6000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1789607537.743836:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607537.743846:0:3471:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 179 00000100:00100000:2.0:1789607537.743881:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c0415db0-4674-4bfe-9696-a490439e72d4:3470:1876539150079232:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789607537.743954:0:3471:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d78c2eb6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607537.743985:0:3471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd116a00 x1876539150079360/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607537.744025:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150078848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607537.744035:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150077440:0@lo:400:kworker.0 00000100:00100000:2.0:1789607537.744040:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539150079360:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:1.0:1789607537.744056:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c0415db0-4674-4bfe-9696-a490439e72d4:3471:1876539150078720:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1789607537.744089:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150079360 offset 0 length 520: 4 00010000:00010000:1.0:1789607537.744960:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607537.745204:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607537.745235:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150079104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607537.745244:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c0415db0-4674-4bfe-9696-a490439e72d4:3468:1876539150078976:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1789607537.760550:0:6454:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876539150078976 offset 224 length 224: 4 00000100:00100000:1.0:1789607537.760592:0:6454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3468:x1876539150078976:12345-0@lo:103:ldlm_bl.0 Request processed in 45921us (46115us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607537.760604:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:3.0:1789607537.765410:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d78e9ee8000) has no exports 00000020:01000000:2.0:1789607537.834355:0:14920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78c30e15a0 - data ffff8d78cf29e6c0/ffff8d78fab35800 00000020:01000000:2.0:1789607537.834512:0:14920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78e0b42360 - data ffff8d78fbd1f948/ffff8d78d9244000 00000001:00000004:2.0:1789607537.850125:0:14920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:2.0:1789607537.891010:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607537.930340:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607537.930349:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789607537.930370:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789607537.938108:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789607537.938116:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:2.0:1789607537.938128:0:14920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607537.938130:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789607537.939407:0:8459:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789607537.939414:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789607537.939425:0:8459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789607537.941490:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789607537.941498:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789607537.941510:0:14920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607537.941512:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789607537.942304:0:9392:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789607537.942311:0:9392:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1789607537.942326:0:9392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789607538.047350:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd244 00000020:00000080:2.0:1789607538.047362:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78faaac000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789607538.047456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaac000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789607538.051377:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd259 00000020:00000080:2.0:1789607538.051391:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78faaaf800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789607538.051408:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789607538.051414:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607538.051422:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789607538.051427:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8d78e9eeb380) has no exports 00000020:00000080:1.0:1789607538.051474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaaf800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1789607538.051790:0:14920:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789607538.051799:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd562 00000020:00000080:2.0:1789607538.051804:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d77c419a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789607538.051819:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789607538.051823:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607538.051831:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789607538.051834:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8d77c4ce4d40) has no exports 00000020:00000080:2.0:1789607538.051841:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd55b 00000020:00000080:2.0:1789607538.051847:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d77c419e000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789607538.051897:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789607538.051906:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789607538.052479:0:14920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789607538.052484:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789607538.052488:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789607538.052495:0:14920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607538.052497:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789607538.052594:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4ecc000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789607538.052608:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607538.052627:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607538.052630:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78fd166800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607538.052633:0:14920:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd166800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789607538.052639:0:14920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607538.052769:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd420 00000020:00000080:2.0:1789607538.052774:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d77c4431800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789607538.052828:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789607538.052833:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607538.052838:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789607538.052841:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8d77c4193380) has no exports 00000020:00000080:2.0:1789607538.052845:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd419 00000020:00000080:2.0:1789607538.052849:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d77c3a58800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789607538.053006:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4431800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1789607538.053419:0:14920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789607538.053422:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789607538.053425:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1789607538.053428:0:14920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607538.053430:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789607538.054439:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607538.054451:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789607538.054465:0:14920:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789607538.054472:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd27c 00000020:00000080:2.0:1789607538.054479:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78fd2d8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789607538.054491:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789607538.054497:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607538.054501:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789607538.054504:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d78f12b0000) has no exports 00000020:00000080:2.0:1789607538.054510:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd275 00000020:00000080:2.0:1789607538.054513:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78fd18d800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789607538.056653:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c3a58800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789607538.056676:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c3a5b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789607538.056686:0:36:0:(genops.c:885:class_export_put()) final put ffff8d77c4199000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789607538.056688:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4199000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789607538.056693:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789607538.056768:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd2d8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789607538.056773:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd18d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789607538.058999:0:14920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789607538.059009:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607538.059014:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789607538.059026:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607538.059082:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607538.059096:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789607538.059129:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607538.059133:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789607538.059139:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78e009f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789607538.059144:0:14920:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789607538.059157:0:14920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789607538.059338:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd260 00000020:00000080:0.0:1789607538.059346:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78faaad000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789607538.059351:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789607538.059356:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607538.059361:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789607538.059378:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8d78e9eecd40) has no exports 00000020:00000080:0.0:1789607538.059397:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607538.059401:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789607538.059405:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd267 00000020:00000080:0.0:1789607538.059410:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78faaaa000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789607538.059418:0:14920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78f05a9800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789607538.059421:0:14920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78f05a9800 2 00000020:01000004:0.0:1789607538.059424:0:14920:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78f05a9800 from lustre-MDT0001 00000020:00000080:0.0:1789607538.059443:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607538.059447:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789607538.059449:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78faaae000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789607538.059451:0:14920:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaae000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789607538.059458:0:14920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789607538.059486:0:14920:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789607538.059490:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789607538.059492:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607538.059495:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789607538.059501:0:14920:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d78e009d800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607538.059505:0:14920:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8d78fd3f4d40) has exports, disconnecting them 00000020:00080000:0.0:1789607538.059509:0:14920:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d78e009d800), last request at 1789607293 00000020:00000080:0.0:1789607538.059513:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd2bb 00000020:00080000:0.0:1789607538.059525:0:14920:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78e009d800): rc 0 00000020:00000080:0.0:1789607538.059528:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78e009d800/lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789607538.060189:0:14920:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789607538.060194:0:14920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607538.060197:0:14920:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607538.060201:0:14920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607538.060347:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607538.060355:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789607538.060361:0:14920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78f05a9800 1 00000020:00000080:0.0:1789607538.060379:0:14920:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd1f7 00000020:00000080:0.0:1789607538.060388:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78f7694800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789607538.060394:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789607538.060399:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607538.060404:0:14920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789607538.060408:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d78f76899c0) has no exports 00000020:00000080:1.0:1789607538.061604:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fd189800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789607538.061613:0:36:0:(genops.c:885:class_export_put()) final put ffff8d78e0a2c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789607538.061616:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e0a2c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789607538.061622:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789607538.061750:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaad000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789607538.061755:0:36:0:(genops.c:885:class_export_put()) final put ffff8d78faaaa800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789607538.061756:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaaa800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789607538.061761:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789607538.061983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaaa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789607538.061989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009d800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789607538.061993:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78e009d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789607538.061998:0:36:0:(genops.c:885:class_export_put()) final put ffff8d78faaab800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789607538.062000:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78faaab800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789607538.062003:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789607538.062035:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f7694800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789607538.080671:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607538.080686:0:14920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789607538.080692:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78f0405000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789607538.080696:0:14920:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f0405000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789607538.080705:0:14920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789607538.080825:0:14920:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d78f0401000 00000020:01000000:1.0:1789607538.080846:0:14920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789607538.080849:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607538.080853:0:14920:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789607538.080856:0:14920:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d78f05b3380) has no exports 00000100:00100000:3.0:1789607538.082500:0:7709:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d78f05f0800:7709] 3 exiting: rc = 0 00000100:00100000:3.0:1789607538.082611:0:6468:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d78f0505000:6468] 0 exiting: rc = 1 00000100:00100000:1.0:1789607538.083891:0:6469:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d78f848b600:6469] 1 exiting: rc = 0 00000100:00100000:3.0:1789607538.083925:0:12196:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8d78faa35800:12196] 4 exiting: rc = 0 00000100:00100000:1.0:1789607538.083947:0:6470:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d78f848b800:6470] 2 exiting: rc = 0 00000100:00100000:1.0:1789607538.084013:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084024:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084029:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084035:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084048:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084057:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084063:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084069:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084075:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084081:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084087:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084092:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084098:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084104:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084109:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084115:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084120:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084125:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084129:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084135:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084155:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084160:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084165:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084169:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084175:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084180:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084186:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084191:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084197:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084202:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084208:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084214:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084219:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084224:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084229:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084233:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084239:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084243:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084248:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084253:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084258:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084263:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084268:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084273:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084278:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084282:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084287:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084292:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084297:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084301:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084306:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084310:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084314:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084320:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084325:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084338:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084343:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084349:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084353:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084358:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084363:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084368:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084373:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.084385:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.088961:0:14272:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8d77c5c19000:14272] 2 exiting: rc = 0 00000100:00100000:1.0:1789607538.090387:0:6471:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d78f848b000:6471] 0 exiting: rc = 1 00000100:00100000:0.0:1789607538.090958:0:6472:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d78f0505600:6472] 1 exiting: rc = 0 00000100:00100000:1.0:1789607538.091004:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091012:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091019:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091025:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091031:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091036:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091405:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091414:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091420:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091426:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091431:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091437:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091443:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091448:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091454:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091459:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091464:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091469:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091474:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091478:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091484:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091489:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091494:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091499:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091504:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091522:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091528:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091533:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091538:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091750:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091760:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091765:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091770:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091774:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091780:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091785:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091790:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091795:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091801:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091805:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091810:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091815:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091821:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091826:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091831:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091836:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091841:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091847:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091852:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091857:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091883:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091890:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091895:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091900:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091905:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091910:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091916:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091921:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091927:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091932:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091946:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091952:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091957:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.091962:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.092777:0:8480:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8d78f61aae00:8480] 2 exiting: rc = 0 00000100:00100000:1.0:1789607538.092918:0:6474:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d78e0678a00:6474] 1 exiting: rc = 0 00000100:00100000:0.0:1789607538.095297:0:6473:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d78e0678800:6473] 0 exiting: rc = 1 00000100:00100000:1.0:1789607538.095379:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095399:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095425:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095433:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095441:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095447:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095453:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095460:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095465:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095470:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095476:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095492:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095498:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095505:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095510:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095516:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095521:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095529:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095534:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095539:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095609:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095615:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095620:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095638:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095644:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095649:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095654:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095660:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095666:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095671:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095686:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095692:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095698:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095703:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095708:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095725:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095731:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095736:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095741:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095747:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095753:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095759:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095765:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095771:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095776:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095782:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095787:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095804:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095811:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095817:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095822:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095827:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095833:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095840:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095847:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095853:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095858:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095936:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.095946:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.096710:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.096720:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.096725:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.096731:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.096745:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.105804:0:6475:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d78f848a800:6475] 0 exiting: rc = 1 00000100:00100000:1.0:1789607538.105924:0:6476:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d78c3a7e600:6476] 1 exiting: rc = 0 00000100:00100000:3.0:1789607538.106133:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106140:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106145:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106149:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106154:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106159:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106163:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106168:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106173:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106177:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106184:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106188:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106192:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106196:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106200:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106204:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106215:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106220:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106224:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106229:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106232:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106237:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106242:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106247:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106252:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106256:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106262:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106266:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106271:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106277:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106282:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106287:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106292:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106297:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106305:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106310:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106315:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106320:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106325:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106329:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106333:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106338:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106342:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106346:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106350:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106357:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106362:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106366:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106370:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106374:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106378:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106388:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106393:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106397:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106401:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106406:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106410:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106414:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106418:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106422:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106426:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106431:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106436:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.106440:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.106927:0:6477:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d78c7bb2600:6477] 0 exiting: rc = 1 00000100:00100000:1.0:1789607538.107060:0:6478:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d78c7bb2000:6478] 1 exiting: rc = 0 00000100:00100000:3.0:1789607538.107213:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107229:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107234:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107238:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107242:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107246:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107250:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107255:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107259:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107264:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107270:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107275:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107280:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107285:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107290:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107296:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107301:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107305:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107310:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107314:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107318:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107323:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107339:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107343:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107348:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107353:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107357:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107363:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107367:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107372:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107377:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107382:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107387:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107392:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107396:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107400:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107405:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107410:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107414:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107419:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107424:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107430:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107435:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107439:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107444:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107448:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107453:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107457:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107462:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107466:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107471:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107475:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107479:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107484:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107488:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107493:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107497:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107509:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107513:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107517:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107522:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107526:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107530:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.107534:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.108086:0:6479:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d78d92fa200:6479] 0 exiting: rc = 1 00000100:00100000:1.0:1789607538.108155:0:6480:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d78d92fb000:6480] 1 exiting: rc = 0 00000100:00100000:3.0:1789607538.109036:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109043:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109048:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109053:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109058:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109063:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109068:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109073:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109077:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109082:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109087:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109091:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109097:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109102:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109106:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109112:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109117:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109122:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109126:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109131:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109136:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109141:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109146:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109151:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109156:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109234:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109238:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109242:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109261:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109265:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109270:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109275:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109279:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109284:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109289:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109293:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109297:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109301:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109638:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109648:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109653:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109658:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109663:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109668:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109672:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109677:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109682:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109687:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109692:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109696:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109701:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109799:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109804:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109809:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109813:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109817:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109822:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109827:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109832:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109837:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109841:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109846:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.109850:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.110165:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607538.110874:0:6481:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d78f05f1e00:6481] 0 exiting: rc = 1 00000100:00100000:1.0:1789607538.111073:0:6482:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d78f05f1400:6482] 1 exiting: rc = 0 00000100:00100000:1.0:1789607538.111419:0:6483:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d78f05f0200:6483] 2 exiting: rc = 0 00000100:00100000:3.0:1789607538.111521:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111528:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111534:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111540:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111637:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111644:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111650:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111656:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111662:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111668:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111673:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111679:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111685:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111690:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111696:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111701:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111707:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111713:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111719:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111725:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111730:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111735:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111741:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111746:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111751:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111758:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111764:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111769:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111788:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111794:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111800:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111805:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111811:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111816:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111833:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111839:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111844:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111850:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111855:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111933:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111941:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111947:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111953:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111958:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111964:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111969:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111974:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111979:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111983:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111989:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111994:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.111999:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112018:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112024:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112030:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112035:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112042:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112047:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112053:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112058:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112063:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112068:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112074:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607538.112079:0:14920:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789607538.116802:0:14920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607538.116817:0:14920:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789607538.116824:0:14920:0:(genops.c:885:class_export_put()) final put ffff8d78f05b8000/MDS_uuid 00000020:00000080:3.0:1789607538.116829:0:14920:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f05b8000/MDS_uuid for MDS 00000020:01000000:3.0:1789607538.116835:0:14920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789607538.116998:0:14920:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789607538.914000:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607539.939073:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607540.962438:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789607541.137058:0:15069:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789607541.146061:0:15069:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789607541.146110:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607541.146125:0:15069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607541.146133:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607541.146141:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607541.146166:0:15069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789607541.146171:0:15069:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789607541.146190:0:15069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607541.146194:0:15069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789607541.146200:0:15069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607541.146206:0:15069:0:(import.c:65:import_set_state_nolock()) ffff8d7901feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789607541.146211:0:15069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607541.146212:0:15069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789607541.146215:0:15069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789607541.146633:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607541.146640:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607541.146648:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075da00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607541.146652:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607541.146660:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607541.146668:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607541.146673:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789607541.146676:0:7735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789607541.146678:0:7735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789607541.146691:0:7735:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:1.0:1789607541.146694:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607541.146701:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075da00/0xa26202d240fbd634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd63b expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607541.146719:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607541.146721:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607541.146722:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607541.147982:0:15069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789607541.147989:0:15069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789607541.147995:0:15069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789607541.148018:0:15069:0:(import.c:65:import_set_state_nolock()) ffff8d77c4447000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789607541.148124:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150079488:0@lo:39:umount.0 00000400:00000100:2.0:1789607541.148188:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150079488 offset 0 length 224: 4 00000100:00080000:2.0:1789607541.474340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607541.474350:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607541.474353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607541.474357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789607541.474361:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607541.474368:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 441 00000100:00080000:2.0:1789607541.474374:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789607541.474386:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78f77e6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607541.474423:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4ebb80 x1876539150079616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607541.474549:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607541.474566:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150079744:0@lo:400:kworker.0 00000400:00000100:0.0:1789607541.474615:0:3470:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150079744 offset 0 length 224: 4 00000100:00100000:3.0:1789607541.474816:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150079616:0@lo:38:kworker.0 00000400:00000100:3.0:1789607541.474841:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150079616 offset 0 length 520: 4 00010000:00010000:1.0:1789607541.986824:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607542.071066:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789607542.071076:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d77c4ba5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607542.071196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4ba5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789607542.071246:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4ba2000 for lustre-OST0001 00000100:00080000:3.0:1789607542.498030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607542.498041:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607542.498043:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607542.498047:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607542.498194:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607542.498212:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150079872:0@lo:400:kworker.0 00000400:00000100:0.0:1789607542.498265:0:3469:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150079872 offset 0 length 224: 4 00000001:00100000:3.0:1789607542.586282:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789607542.586291:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d77c3a5d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607542.586422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c3a5d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789607542.586469:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c3a5f800 for lustre-OST0000 00010000:00010000:2.0:1789607543.010216:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607544.034131:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607545.058130:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607546.082100:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607546.530284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607546.530295:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607546.530298:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607546.530352:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607546.530521:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150080000:0@lo:400:kworker.0 00000400:00000100:0.0:1789607546.530590:0:3469:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150080000 offset 0 length 224: 4 00010000:00010000:0.0:1789607547.106375:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607547.618195:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607537/real 1789607537] req@ffff8d78fd116a00 x1876539150079360/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607547 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607547.618227:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fd116a00 x1876539150079360/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607547 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607547.618255:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607547.618277:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789607547.618281:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539150079360:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1789607547.619035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607547.619043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789607547.619046:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607547.619051:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:3.0:1789607547.619056:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789607547.619067:0:8:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d78c2eb6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607547.619094:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0702d80 x1876539150080128/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607547.619124:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607547.619128:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607547.619192:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607547.619209:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150080256:0@lo:400:kworker.0 00000100:00100000:0.0:1789607547.619219:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539150080128:0@lo:250:kworker.0 00000400:00000100:0.0:1789607547.622599:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150080128 offset 0 length 520: 4 00000400:00000100:1.0:1789607547.622722:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150080256 offset 0 length 224: 4 00010000:00010000:1.0:1789607548.131702:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607549.154149:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607550.178077:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607551.202385:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607551.714126:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607541/real 1789607541] req@ffff8d78fcd82a00 x1876539150079488/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607551 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607551.714166:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fcd82a00 x1876539150079488/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607551 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607551.714190:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4447000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789607551.714220:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150079488:0@lo:39:umount.0 00000100:00080000:3.0:1789607551.714266:0:15069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789607551.714272:0:15069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789607551.714277:0:15069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789607551.715194:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715227:0:15069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715234:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715240:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715267:0:15069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607551.715274:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715280:0:15069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715286:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715291:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607551.715309:0:15069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789607551.715313:0:15069:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789607551.715338:0:15069:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789607551.715342:0:15069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789607551.715347:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607551.715352:0:15069:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789607551.715357:0:15069:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8d77c41919c0) has no exports 00010000:00010000:0.0:1789607551.715367:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607551.715375:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715384:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053000 already unused, calling callback (ffffffffc1dfbc20) 00000020:00080000:3.0:1789607551.715388:0:15069:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8d77c41919c0) has no exports 10000000:00010000:0.0:1789607551.715388:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715399:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607551.715406:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607551.715411:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607551.715414:0:7735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789607551.715416:0:7735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789607551.715429:0:7735:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:0.0:1789607551.715433:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715439:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902053000/0xa26202d240fbd642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd649 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715479:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607551.715482:0:7735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715488:0:7735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607551.715492:0:7735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715499:0:7735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607551.715506:0:7735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607551.715512:0:7735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789607551.715514:0:7735:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789607551.715516:0:7735:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789607551.715522:0:7735:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:0.0:1789607551.715525:0:7735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715532:0:7735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd581400/0xa26202d240fbd8bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd8c6 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607551.715540:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607551.715542:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607551.715543:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789607551.717014:0:15069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78c30e1240 - data ffff8d78fbe45ca8/ffff8d77c400e000 00000020:01000000:3.0:1789607551.717136:0:15069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d79010bdde0 - data ffff8d78fbd960d8/ffff8d77c4144c00 00010000:00010000:2.0:1789607551.717463:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789607551.728670:0:15069:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789607551.776211:0:15069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd394 00000020:00000080:2.0:1789607551.776230:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d77c419c000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789607551.776241:0:15069:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7901022000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789607551.776244:0:15069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7901022000 2 00000020:01000004:2.0:1789607551.776247:0:15069:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d7901022000 from lustre-OST0000 00000020:00000080:2.0:1789607551.776268:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607551.776278:0:15069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789607551.776281:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d77c419f000/lustre-OST0000_UUID 00000020:00000080:2.0:1789607551.776284:0:15069:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789607551.776290:0:15069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789607551.776348:0:15069:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789607551.776353:0:15069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789607551.776356:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607551.776361:0:15069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789607551.776367:0:15069:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d78e009b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607551.776373:0:15069:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8d78f05b4d40) has exports, disconnecting them 00000020:00080000:2.0:1789607551.776378:0:15069:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d78e009b000), last request at 1789607310 00000020:00000080:2.0:1789607551.776383:0:15069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd3be 00000020:00080000:2.0:1789607551.776391:0:15069:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78e009b000): rc 0 00000020:00000080:2.0:1789607551.776396:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d78e009b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789607551.776898:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789607551.776910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789607551.779971:0:15069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789607551.779980:0:15069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789607551.779984:0:15069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789607551.779991:0:15069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789607551.780033:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d7901feb800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789607551.780173:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607551.780181:0:15069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789607551.780187:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d77c4441800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789607551.780191:0:15069:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4441800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789607551.780197:0:15069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789607551.780250:0:15069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789607551.780254:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607551.780259:0:15069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789607551.780265:0:15069:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d77c4430000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789607551.780271:0:15069:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8d77c4554d40) has exports, disconnecting them 00000020:00080000:3.0:1789607551.780275:0:15069:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d77c4430000), last request at 1789607310 00000020:00000080:3.0:1789607551.780279:0:15069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd3d3 00000020:00080000:3.0:1789607551.780292:0:15069:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c4430000): rc 0 00000020:00000080:3.0:1789607551.780295:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d77c4430000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789607551.781871:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4430000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789607551.811128:0:15069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789607551.811137:0:15069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789607551.811142:0:15069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789607551.811149:0:15069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789607551.811630:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607551.811642:0:15069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789607551.811649:0:15069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7901022000 1 00000020:00000080:3.0:1789607551.811655:0:15069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd35c 00000020:00000080:3.0:1789607551.811664:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d78fcb58800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789607551.811670:0:15069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789607551.811675:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607551.811679:0:15069:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789607551.811683:0:15069:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d78f05b0000) has no exports 00000020:00000080:1.0:1789607551.813382:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c4447000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789607551.813759:0:8:0:(genops.c:885:class_export_put()) final put ffff8d77c4444800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789607551.813763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4444800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789607551.813776:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789607551.813835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fcb58800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789607551.847164:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607551.847180:0:15069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789607551.847186:0:15069:0:(genops.c:885:class_export_put()) final put ffff8d78fd160000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789607551.847192:0:15069:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd160000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789607551.847201:0:15069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789607551.847329:0:15069:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d7901025000 00000020:02000400:1.0:1789607551.847382:0:15069:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789607552.226965:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607552.738267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607552.738277:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607552.738280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607552.738283:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607552.738391:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150080384:0@lo:400:kworker.0 00000400:00000100:1.0:1789607552.738439:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150080384 offset 0 length 224: 4 00010000:00010000:1.0:1789607553.252074:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607554.275148:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789607554.542649:0:15222:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789607554.554068:0:15222:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789607554.554156:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607554.554170:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607554.554177:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607554.554184:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607554.554213:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789607554.554219:0:15222:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789607554.554240:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789607554.554251:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fd4ebb80 x1876539150079616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607554.554271:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789607554.554321:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789607554.554328:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8d78f77e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789607554.554333:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789607554.554336:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fd4ebb80 x1876539150079616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607561 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607554.554343:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:2.0:1789607554.554388:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607554.554396:0:6457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607554.554413:0:6457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902052800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607554.554417:0:6457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607554.554425:0:6457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607554.554432:0:6457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607554.554438:0:6457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607554.554440:0:6457:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789607554.554442:0:6457:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789607554.554468:0:6457:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:2.0:1789607554.554472:0:6457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607554.554480:0:6457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902052800/0xa26202d240fbd618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd61f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607554.554490:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607554.554492:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607554.554494:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607554.555286:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150079616:0@lo:38:kworker.0 00000100:00100000:1.0:1789607554.555393:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789607554.561638:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789607554.561657:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fd4e8380 x1876539150079744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607554.561684:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78f0700700 x1876539150079872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607554.561787:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150079744:0@lo:400:kworker.0 00000100:00100000:1.0:1789607554.561821:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fd4eb800 x1876539150080000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607554.561830:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78f0701f80 x1876539150080256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607563 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607554.561844:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78fd4e8700 x1876539150080384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607554.561852:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789607554.561905:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150080384:0@lo:400:kworker.0 00000100:00100000:2.0:1789607554.561955:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150079872:0@lo:400:kworker.0 00000100:00100000:1.0:1789607554.562203:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150080256:0@lo:400:kworker.0 00000100:00080000:1.0:1789607554.562225:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789607554.562252:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8d7901fec800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789607554.562321:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150080512:0@lo:39:umount.0 00000400:00000100:0.0:1789607554.562372:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150080512 offset 0 length 224: 4 00000100:00100000:2.0:1789607554.562534:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150080000:0@lo:400:kworker.0 00010000:00010000:1.0:1789607555.301600:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607556.322557:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607557.346071:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607557.858275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607557.858284:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789607558.375736:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607559.396045:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607560.418164:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607561.442532:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607562.468053:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607562.786188:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607547/real 1789607547] req@ffff8d78f0702d80 x1876539150080128/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607562.786223:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78f0702d80 x1876539150080128/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607562.786244:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607562.786271:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789607562.786275:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539150080128:0@lo:250:kworker.0 00000100:00080000:3.0:1789607562.786569:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c0415db0-4674-4bfe-9696-a490439e72d4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607562.786575:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789607562.786577:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607562.786582:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1789607562.786587:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.125@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789607562.786598:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d78c2eb6000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607562.786639:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0700000 x1876539150080640/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607562.787119:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539150080640:0@lo:250:kworker.0 00000400:00000100:0.0:1789607562.787168:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150080640 offset 0 length 520: 4 00010000:00010000:2.0:1789607563.491619:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607564.514304:0:7735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607564.834206:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607554/real 1789607554] req@ffff8d78fd115880 x1876539150080512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607564.834252:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fd115880 x1876539150080512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607564.834277:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7901fec800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789607564.834304:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150080512:0@lo:39:umount.0 00000100:00080000:1.0:1789607564.834731:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789607564.834737:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789607564.834744:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789607564.840942:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.840970:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.841006:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.841014:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.841832:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607564.841848:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.841859:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.841893:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607564.841900:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842026:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607564.842036:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842044:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7902053400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607564.842049:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842059:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607564.842075:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607564.842082:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607564.842085:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789607564.842100:0:6458:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:2.0:1789607564.842105:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842113:0:6458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7902053400/0xa26202d240fbd626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd62d expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842136:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607564.842140:0:6458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842158:0:6458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607564.842160:0:6458:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842167:0:6458:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607564.842174:0:6458:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607564.842180:0:6458:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789607564.842182:0:6458:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789607564.842187:0:6458:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:2.0:1789607564.842190:0:6458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.842198:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607564.842200:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607564.842202:0:6458:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607564.842390:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789607564.842395:0:15222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbd8b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd8b8 expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607564.842413:0:15222:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789607564.842418:0:15222:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789607564.842421:0:15222:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789607564.842463:0:15222:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789607564.842470:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789607564.842477:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607564.842492:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789607564.842497:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8d77c4550000) has no exports 00000020:00080000:1.0:1789607564.842542:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8d77c4550000) has no exports 00010000:00010000:2.0:1789607564.843691:0:6457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789607564.845027:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78c30e12a0 - data ffff8d78cf257000/ffff8d77c51f3c00 00000020:01000000:1.0:1789607564.845308:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78d9376720 - data ffff8d78fbd436c0/ffff8d77c51f3400 00100000:10000000:1.0:1789607564.853958:0:15222:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789607564.920072:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd4ba 00000020:00000080:2.0:1789607564.920082:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d7901fea000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789607564.920093:0:15222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78f77e7800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789607564.920097:0:15222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78f77e7800 2 00000020:01000004:2.0:1789607564.920105:0:15222:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78f77e7800 from lustre-OST0001 00000020:00000080:0.0:1789607564.920175:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7901fea000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789607564.920241:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607564.920251:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789607564.920254:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d78f77e3000/lustre-OST0001_UUID 00000020:00000080:2.0:1789607564.920257:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789607564.920263:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789607564.920487:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c0415db0-4674-4bfe-9696-a490439e72d4->MGS 00010000:00010000:2.0:1789607564.920504:0:15222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbd213 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607564.920516:0:15222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbd213 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607564.920522:0:15222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789607564.920524:0:15222:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789607564.920528:0:15222:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789607564.920541:0:15222:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:2.0:1789607564.920554:0:15222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbd213 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd21a expref: -99 pid: 7259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607564.920571:0:15222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607564.920578:0:15222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607564.920584:0:15222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607564.920586:0:15222:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789607564.920588:0:15222:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789607564.920596:0:15222:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d78c2eb6000 00010000:00010000:2.0:1789607564.920598:0:15222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbd688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbd68f expref: -99 pid: 6466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789607564.920700:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8d78c2eb6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789607564.920705:0:15222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789607564.920707:0:15222:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789607564.920709:0:15222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789607564.920713:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789607564.920729:0:15222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78f0700000 x1876539150080640/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789607582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789607564.920750:0:15222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789607564.920753:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1789607564.921023:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c0415db0-4674-4bfe-9696-a490439e72d4:3467:1876539150080640:0@lo:250:kworker.0 10000000:01000000:2.0:1789607564.921110:0:15222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789607564.921122:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd110 00000020:00000080:2.0:1789607564.921128:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d78f05bc000/c0415db0-4674-4bfe-9696-a490439e72d4 00000020:01000000:2.0:1789607564.921137:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.125@tcp (flags='') 00000020:00000080:2.0:1789607564.921143:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607564.921148:0:15222:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789607564.921151:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d78e9ee99c0) has no exports 10000000:01000000:1.0:1789607564.921218:0:6466:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789607564.921258:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.125@tcp: client import never connected 00000100:00080000:2.0:1789607564.921261:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789607564.921263:0:15222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789607564.921265:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789607564.921267:0:15222:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789607564.921327:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607564.921331:0:15222:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.125@tcp (uuid c0415db0-4674-4bfe-9696-a490439e72d4) 00000020:01000000:2.0:1789607564.921336:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789607564.921339:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607564.921342:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789607564.921351:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d77c419b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607564.921379:0:15222:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8d77c4ce0000) has exports, disconnecting them 00000020:00080000:2.0:1789607564.921384:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d77c419b800), last request at 1789607332 00000020:00000080:2.0:1789607564.921387:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd4e4 00000020:00080000:2.0:1789607564.921398:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c419b800): rc 0 00000020:00000080:2.0:1789607564.921401:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d77c419b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789607564.922945:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f05bc000/c0415db0-4674-4bfe-9696-a490439e72d4 for MGC192.168.203.125@tcp 00000020:00000080:0.0:1789607564.922960:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78c2eb6000 for MGC192.168.203.125@tcp 00000020:00000080:0.0:1789607564.922969:0:36:0:(genops.c:885:class_export_put()) final put ffff8d78c2eb2000/c0415db0-4674-4bfe-9696-a490439e72d4 00000020:00000080:0.0:1789607564.922984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c2eb2000/c0415db0-4674-4bfe-9696-a490439e72d4 for MGC192.168.203.125@tcp 00000020:01000000:0.0:1789607564.922988:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.125@tcp (c0415db0-4674-4bfe-9696-a490439e72d4) 00000020:00000080:0.0:1789607564.923252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789607565.019064:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789607565.019073:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607565.019078:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607565.019086:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607565.019288:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607565.019296:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789607565.019315:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789607565.019322:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607565.019327:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789607565.019335:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d77c4d65000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607565.019342:0:15222:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8d78fd3f19c0) has exports, disconnecting them 00000020:00080000:0.0:1789607565.019347:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d77c4d65000), last request at 1789607332 00000020:00000080:0.0:1789607565.019351:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd4f9 00000020:00080000:0.0:1789607565.019375:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c4d65000): rc 0 00000020:00000080:0.0:1789607565.019381:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d77c4d65000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789607565.020069:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f77e6000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789607565.020078:0:36:0:(genops.c:885:class_export_put()) final put ffff8d77c4d64800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789607565.020081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4d64800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789607565.020091:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789607565.020143:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c4d65000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789607565.022911:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789607565.022919:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789607565.022924:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789607565.022931:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789607565.022962:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d7901fec800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789607565.027160:0:7735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789607565.032925:0:6458:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789607565.040019:0:6457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789607565.040188:0:6453:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d78f046d800:6453] 1 exiting: rc = 0 00000100:00100000:1.0:1789607565.040253:0:6452:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d78f046c400:6452] 0 exiting: rc = 1 00000100:00100000:2.0:1789607565.043019:0:9064:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d78faae4c00:9064] 2 exiting: rc = 0 00000100:00100000:1.0:1789607565.044799:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045118:0:6456:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d78f046c800:6456] 2 exiting: rc = 0 00000100:00100000:1.0:1789607565.045183:0:6455:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d78f046cc00:6455] 1 exiting: rc = 0 00000100:00100000:1.0:1789607565.045265:0:6454:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d78f046c000:6454] 0 exiting: rc = 1 00000100:00100000:1.0:1789607565.045337:0:7268:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d78e9e36800:7268] 3 exiting: rc = 0 00000100:00100000:1.0:1789607565.045390:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045397:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045403:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045408:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045415:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045433:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045438:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045444:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045450:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045455:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045460:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045465:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045471:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045476:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045482:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045487:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045493:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045498:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045503:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045510:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045516:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045521:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045525:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045530:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045536:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045541:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045546:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045552:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045557:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045563:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045568:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045573:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045579:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045584:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045589:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045594:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045599:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045606:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045611:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045616:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045630:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045636:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045641:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045646:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045652:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045657:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045663:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045667:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045672:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045677:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045682:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045686:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045691:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045696:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045701:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045707:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045713:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045719:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045724:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045728:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045733:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045738:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045743:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.045748:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789607565.048621:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607565.048634:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789607565.048640:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d77c419c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789607565.048644:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789607565.048649:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789607565.048691:0:15222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78f77e7800 1 00000020:00000080:1.0:1789607565.048696:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbd489 00000020:00000080:1.0:1789607565.048702:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d78fc943800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789607565.048715:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789607565.048726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fc943800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789607565.048748:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607565.048753:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789607565.048757:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8d77c4553380) has no exports 00000020:00000080:2.0:1789607565.199949:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607565.199962:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789607565.199967:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d78f77e0800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789607565.199972:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77e0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789607565.199984:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789607565.200632:0:15222:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d78f77e4800 00000020:01000000:2.0:1789607565.200655:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789607565.200660:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607565.200665:0:15222:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607565.200669:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8d78f7688000) has no exports 00000020:00000080:2.0:1789607565.200702:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607565.200710:0:15222:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789607565.200713:0:15222:0:(genops.c:885:class_export_put()) final put ffff8d78fcb5f800/OSS_uuid 00000020:00000080:2.0:1789607565.200716:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fcb5f800/OSS_uuid for OSS 00000020:01000000:2.0:1789607565.200720:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789607565.200857:0:8112:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d78e06c9000:8112] 0 exiting: rc = 1 00000100:00100000:1.0:1789607565.200977:0:9649:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d77c5937e00:9649] 3 exiting: rc = 0 00000100:00100000:1.0:1789607565.201032:0:8113:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d78fa548200:8113] 1 exiting: rc = 0 00000100:00080000:0.0:1789607565.201167:0:6465:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789607565.205972:0:13082:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8d78d92f2e00:13082] 4 exiting: rc = 0 00000100:00100000:2.0:1789607565.209446:0:8114:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d79010be000:8114] 2 exiting: rc = 0 00000100:00100000:0.0:1789607565.212546:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212568:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212584:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212595:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212606:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212613:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212618:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212627:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212636:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212648:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212657:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212680:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212688:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212697:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212707:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212715:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212723:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212730:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212735:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212745:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212753:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212762:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212770:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212779:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212788:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212796:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212806:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212815:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212824:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212830:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212837:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212846:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212856:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212892:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212902:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212914:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212923:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212932:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212942:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212949:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212954:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212959:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212965:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212971:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212976:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212983:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.212998:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213005:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213015:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213026:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213035:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213048:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213060:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213070:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213081:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213091:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213101:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213110:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213120:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213126:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213133:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213141:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213148:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.213157:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.216699:0:8115:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d78e9cc8200:8115] 0 exiting: rc = 1 00000100:00100000:0.0:1789607565.217510:0:8116:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d78f61aa800:8116] 1 exiting: rc = 0 00000100:00100000:2.0:1789607565.228324:0:9818:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d78e9d8de00:9818] 2 exiting: rc = 0 00000100:00100000:3.0:1789607565.228809:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228820:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228827:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228833:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228839:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228845:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228851:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228857:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228882:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228888:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228893:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228913:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228918:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228923:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228927:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228932:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228937:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228942:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228947:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228952:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228957:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228963:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228968:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228973:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228979:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228984:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228989:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.228995:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229000:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229005:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229010:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229015:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229020:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229025:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229030:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229045:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229052:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229062:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229068:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229073:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229078:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229083:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229088:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229093:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229098:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229103:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229113:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229118:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229123:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229128:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229133:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229138:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229158:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229164:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229171:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229178:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229183:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229188:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229193:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229198:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229204:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229209:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229214:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.229220:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607565.230591:0:8119:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d78f61ab800:8119] 2 exiting: rc = 0 00000100:00100000:0.0:1789607565.231124:0:8117:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d78f61aa000:8117] 0 exiting: rc = 1 00000100:00100000:0.0:1789607565.232252:0:8118:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d78f61aaa00:8118] 1 exiting: rc = 0 00000100:00100000:3.0:1789607565.232493:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232502:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232509:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232514:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232521:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232527:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232532:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232537:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232554:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232567:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232573:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232579:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232584:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232590:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232595:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232601:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232618:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232646:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232653:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232660:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232667:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232674:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232679:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232686:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232693:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232700:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232707:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232712:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232718:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232724:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232730:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232737:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232762:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232769:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232776:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232782:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232788:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232795:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232800:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232805:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232810:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232816:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232822:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232828:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232835:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232841:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232846:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232853:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232884:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232892:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232897:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232902:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232916:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232921:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232927:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232932:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232938:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232943:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232957:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232964:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232970:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232976:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232982:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.232988:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.242805:0:8120:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d78d937f600:8120] 0 exiting: rc = 1 00000100:00100000:2.0:1789607565.242805:0:8121:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d790107ba00:8121] 1 exiting: rc = 0 00000100:00100000:3.0:1789607565.246583:0:9411:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff8d77c4188000:9411] 2 exiting: rc = 0 00000100:00100000:3.0:1789607565.246681:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246690:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246695:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246701:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246706:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246711:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246716:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246721:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246726:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246731:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246736:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246741:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246746:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246751:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246755:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246760:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246766:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246771:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246777:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246782:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246788:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246807:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246812:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246831:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246837:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246842:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246848:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246853:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246858:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246881:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246886:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246891:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246897:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246902:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246906:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246911:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246916:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246921:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246925:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246931:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246936:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246941:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246946:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246951:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246956:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246961:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246966:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246972:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246977:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246984:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246989:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.246996:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247002:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247007:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247012:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247017:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247031:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247036:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247041:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247046:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247051:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247057:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247061:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.247066:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607565.249142:0:8122:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d78e9d8a600:8122] 0 exiting: rc = 1 00000100:00100000:1.0:1789607565.249236:0:8123:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d77c10fe600:8123] 1 exiting: rc = 0 00000100:00100000:3.0:1789607565.251499:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251510:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251516:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251526:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251546:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251554:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251559:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251566:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251572:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251578:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251583:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251589:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251595:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251600:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251606:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251612:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251633:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251641:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251648:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251655:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251661:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251667:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251673:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251679:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251686:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251692:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251698:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251719:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251740:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251749:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251755:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251761:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251767:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251773:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251778:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251784:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251790:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251796:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251802:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251809:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251831:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251839:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251845:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251851:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251858:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251884:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251891:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251897:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251903:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251909:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251915:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251921:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251946:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251954:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251962:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251968:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251973:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251979:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251984:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251989:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.251995:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.252000:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.252011:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607565.252017:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789607565.272633:0:15222:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789607587.424567:0:15948:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789607595.816367:0:16411:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789607595.816374:0:16411:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789607595.816585:0:16411:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d77c419c000 00000020:01000004:3.0:1789607595.816603:0:16411:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789607595.816611:0:16411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789607595.816626:0:16411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d78f12b19c0) 00000020:00000080:3.0:1789607595.816639:0:16411:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789607595.858026:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789607595.861456:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789607595.862000:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1789607595.862281:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1789607595.862384:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1789607595.862495:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1789607595.863182:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789607595.863259:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1789607595.863368:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 451: rc = 0 00100000:10000000:1.0:1789607595.863510:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1789607595.864196:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1789607595.868052:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 373: rc = 0 00100000:10000000:1.0:1789607595.868171:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 373: rc = 0 00100000:10000000:1.0:1789607595.868995:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 378: rc = 0 00100000:10000000:1.0:1789607595.869331:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 378: rc = 0 00100000:10000000:1.0:1789607595.869599:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 378: rc = 0 00100000:10000000:1.0:1789607595.870283:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 378: rc = 0 00100000:10000000:1.0:1789607595.870542:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 378: rc = 0 00100000:10000000:1.0:1789607595.870831:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 378: rc = 0 00100000:10000000:1.0:1789607595.871397:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 378: rc = 0 00100000:10000000:1.0:1789607595.871846:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 378: rc = 0 00100000:10000000:1.0:1789607595.872205:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 378: rc = 0 00100000:10000000:1.0:1789607595.872452:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 378: rc = 0 00100000:10000000:1.0:1789607595.875309:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 378: rc = 0 00100000:10000000:1.0:1789607595.876282:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 378: rc = 0 00100000:10000000:1.0:1789607595.877118:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 772: rc = 0 00100000:10000000:1.0:1789607595.877393:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 772: rc = 0 00100000:10000000:1.0:1789607595.877635:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 772: rc = 0 00100000:10000000:1.0:1789607595.877912:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 772: rc = 0 00100000:10000000:1.0:1789607595.878178:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 772: rc = 0 00100000:10000000:1.0:1789607595.878465:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 772: rc = 0 00100000:10000000:1.0:1789607595.878709:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 772: rc = 0 00100000:10000000:1.0:1789607595.878964:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 772: rc = 0 00100000:10000000:2.0:1789607595.887551:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 772: rc = 0 00100000:10000000:2.0:1789607595.888061:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 772: rc = 0 00100000:10000000:2.0:1789607595.888340:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 772: rc = 0 00100000:10000000:2.0:1789607595.888588:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 772: rc = 0 00100000:10000000:2.0:1789607595.890317:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 772: rc = 0 00100000:10000000:2.0:1789607595.890600:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 772: rc = 0 00100000:10000000:2.0:1789607595.895331:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 772: rc = 0 00100000:10000000:2.0:1789607595.895659:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 772: rc = 0 00100000:10000000:2.0:1789607595.896676:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 772: rc = 0 00100000:10000000:2.0:1789607595.898278:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 772: rc = 0 00100000:10000000:2.0:1789607595.898691:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 772: rc = 0 00100000:10000000:2.0:1789607595.899034:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 772: rc = 0 00100000:10000000:2.0:1789607595.899339:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 772: rc = 0 00100000:10000000:2.0:1789607595.899591:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 772: rc = 0 00100000:10000000:2.0:1789607595.899843:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 772: rc = 0 00100000:10000000:2.0:1789607595.900157:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 772: rc = 0 00100000:10000000:2.0:1789607595.900406:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 772: rc = 0 00100000:10000000:2.0:1789607595.900643:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 772: rc = 0 00100000:10000000:2.0:1789607595.900903:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 772: rc = 0 00100000:10000000:2.0:1789607595.902541:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 772: rc = 0 00100000:10000000:2.0:1789607595.903098:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 772: rc = 0 00100000:10000000:2.0:1789607595.903470:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 772: rc = 0 00100000:10000000:2.0:1789607595.903787:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 772: rc = 0 00100000:10000000:2.0:1789607595.904211:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 772: rc = 0 00100000:10000000:2.0:1789607595.904551:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 457: rc = 0 00100000:10000000:2.0:1789607595.904962:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 457: rc = 0 00100000:10000000:2.0:1789607595.906105:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789607595.906524:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 551: rc = 0 00100000:10000000:2.0:1789607595.906719:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789607595.906956:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 551: rc = 0 00100000:10000000:2.0:1789607595.907355:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789607595.907494:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 551: rc = 0 00100000:10000000:2.0:1789607595.908016:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789607595.908083:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 374: rc = 0 00100000:10000000:2.0:1789607595.908532:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789607595.908595:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 374: rc = 0 00100000:10000000:2.0:1789607595.908951:0:16411:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789607595.909083:0:16411:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 374: rc = 0 00000020:00000080:2.0:1789607595.909553:0:16411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789607595.909562:0:16411:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789607595.909573:0:16411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe66b 00000020:01000004:2.0:1789607595.909581:0:16411:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789607595.909587:0:16411:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789607595.909592:0:16411:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d77c419c000 from MGS 00000020:01000004:2.0:1789607595.909596:0:16411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789607595.909606:0:16411:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d77c4ce4d40) 00000020:00000080:2.0:1789607595.909617:0:16411:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789607595.909672:0:16411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c419c000 from MGS, refs=2 00080000:01000000:2.0:1789607595.909677:0:16411:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607595.909681:0:16411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe679 00000100:00100000:2.0:1789607595.910114:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789607595.910457:0:16411:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789607595.910464:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789607595.911453:0:16411:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789607595.911463:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789607595.913108:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607595.913358:0:16411:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789607595.913364:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789607595.914150:0:16411:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789607595.914158:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789607595.914444:0:16411:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789607595.914450:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789607595.915180:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607595.915184:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607595.915185:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607595.915634:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607595.915637:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607595.915639:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607595.916553:0:16411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789607595.918461:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789607595.934781:0:16411:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789607595.935061:0:16411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789607595.935064:0:16411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789607595.939564:0:16420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789607595.939726:0:16411:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789607595.939844:0:16411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789607595.940359:0:16411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789607595.940662:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607595.940810:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789607595.940816:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789607595.955334:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789607595.955355:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789607595.957374:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789607595.957385:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789607595.958079:0:16411:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789607595.958099:0:16411:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.125@tcp' 00000020:01000004:0.0:1789607595.958101:0:16411:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789607595.958128:0:16411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.125@tcp (typ=mgc) 00000020:00000080:0.0:1789607595.958151:0:16411:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.125@tcp (ffff8d78fd3f3380) 00000020:00000080:0.0:1789607595.958167:0:16411:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789607595.958234:0:16411:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d79013bc800@MGC192.168.203.125@tcp: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607595.958379:0:16411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.125@tcp-0 is initialized 00000040:01000000:0.0:1789607595.958385:0:16411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789607595.958613:0:16425:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789607595.962668:0:16427:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789607595.962718:0:16411:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.125@tcp (uuid 7095b5c7-e12e-406f-ad0b-bb55e8b45703) 00000020:00000080:0.0:1789607595.962739:0:16411:0:(genops.c:1384:class_connect()) connect: client 7095b5c7-e12e-406f-ad0b-bb55e8b45703, cookie 0xa26202d240fbe687 00000100:00080000:0.0:1789607595.962749:0:16411:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607595.962760:0:16411:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d79013bc800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607595.962805:0:16411:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd82d80 x1876539150080768/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607595.962826:0:16411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS 00000020:01000004:0.0:1789607595.962852:0:16411:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789607595.962857:0:16411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789607595.962887:0:16411:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d78fd3f0000) 00000020:00000080:0.0:1789607595.962898:0:16411:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789607595.969949:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150080768:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789607595.970031:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607595.970165:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150080768 00000100:00100000:2.0:1789607595.970173:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150080768 00000100:00100000:2.0:1789607595.970208:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607595.970215:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3467:x1876539150080768:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789607595.970238:0:16421:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7095b5c7-e12e-406f-ad0b-bb55e8b45703@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1789607595.970265:0:16421:0:(genops.c:1384:class_connect()) connect: client 7095b5c7-e12e-406f-ad0b-bb55e8b45703, cookie 0xa26202d240fbe695 00000100:00080000:2.0:1789607595.970373:0:16421:0:(import.c:65:import_set_state_nolock()) ffff8d78e0a28000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607595.970428:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+5:3467:x1876539150080768:12345-0@lo:250:mount.lustre.0 Request processed in 212us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607595.970435:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607595.970471:0:3467:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789607595.970478:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.125@tcp: connect to target with instance 0 00000100:00080000:2.0:1789607595.970485:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789607595.970490:0:3467:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789607595.970492:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789607595.970495:0:3467:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789607595.970502:0:3467:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789607595.970507:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150080768:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789607595.974496:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607595.974730:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789607595.974736:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789607595.978653:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789607595.978668:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789607595.979357:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789607595.979365:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789607595.981001:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607595.981190:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789607595.981196:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789607595.981696:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789607595.981703:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789607596.040009:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607596.040220:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789607596.040227:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789607596.041853:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789607596.041888:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789607596.043809:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607596.045038:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789607596.045045:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789607596.046153:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789607596.046161:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789607596.046757:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607596.046958:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789607596.046963:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789607596.049314:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789607596.049328:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789607596.050354:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607596.050698:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789607596.050705:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789607596.053526:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789607596.053539:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789607596.090612:0:16411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607596.090816:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607596.090823:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789607596.091791:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789607596.091804:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789607596.096378:0:16411:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789607596.096403:0:16411:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789607596.097327:0:16411:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789607596.097349:0:16411:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789607596.097354:0:16411:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789607596.097491:0:16411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789607596.097529:0:16411:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789607596.097532:0:16411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789607596.097534:0:16411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607596.097535:0:16411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607596.097537:0:16411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607596.097538:0:16411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607596.097539:0:16411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607596.097540:0:16411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607596.097542:0:16411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607596.097543:0:16411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607596.097545:0:16411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607596.097548:0:16411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789607596.097550:0:16411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607596.097551:0:16411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607596.097552:0:16411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607596.097553:0:16411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607596.097554:0:16411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607596.097555:0:16411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607596.097556:0:16411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607596.097557:0:16411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607596.097558:0:16411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607596.097559:0:16411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607596.097595:0:16411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789607596.097615:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150080896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607596.097693:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.097738:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.097909:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150080896 00000100:00100000:0.0:1789607596.097916:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150080896 00000100:00100000:0.0:1789607596.097955:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607596.097965:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f618b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+5:16411:x1876539150080896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607596.098009:0:16424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789607596.098017:0:16424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789607596.098019:0:16424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789607596.098428:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789607596.098774:0:16424:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789607596.100032:0:16445:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789607596.100038:0:16445:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789607596.100042:0:16445:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789607596.100053:0:16445:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789607596.100104:0:16445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789607596.100384:0:16424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789607596.100404:0:16424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789607596.111159:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f618b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+5:16411:x1876539150080896:12345-0@lo:253:mount.lustre.0 Request processed in 13187us (13457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.111173:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607596.111186:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150080896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607596.111199:0:16411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789607596.111214:0:16411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607596.111216:0:16411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607596.111218:0:16411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607596.111219:0:16411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607596.111221:0:16411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607596.111222:0:16411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607596.111223:0:16411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607596.111224:0:16411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607596.111226:0:16411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607596.111228:0:16411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789607596.111244:0:16411:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d77c419c000 from lustre-MDT0000 10000000:01000000:2.0:1789607596.111270:0:16411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789607596.111273:0:16411:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789607596.111277:0:16411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d78fd3f3380 10000000:01000000:2.0:1789607596.111281:0:16411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607596.111289:0:16411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78fd3f3380 from 1 10000000:01000000:2.0:1789607596.111292:0:16411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789607596.111325:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.111334:0:16411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.111344:0:16411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.111361:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607596.111393:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.111431:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.111445:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081024 00000100:00100000:1.0:1789607596.111451:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081024 00000100:00100000:1.0:1789607596.111489:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607596.111499:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+5:16411:x1876539150081024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607596.111511:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607596.111524:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9185000/0xa26202d240fbe6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe69c expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.111545:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9185000/0xa26202d240fbe6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe69c expref: 6 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.111564:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9185000/0xa26202d240fbe6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe69c expref: 6 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.111572:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185000, rc 0) 00000100:00100000:1.0:1789607596.111604:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+6:16411:x1876539150081024:12345-0@lo:101:mount.lustre.0 Request processed in 107us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.111609:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607596.111617:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607596.111629:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.111648:0:16411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.111691:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607596.111716:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.111737:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.111764:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081152 00000100:00100000:0.0:1789607596.111768:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081152 00000100:00100000:0.0:1789607596.111795:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607596.111801:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+6:16411:x1876539150081152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607596.112051:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+6:16411:x1876539150081152:12345-0@lo:501:mount.lustre.0 Request processed in 249us (333us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607596.112058:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607596.112247:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081152:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789607596.112273:0:16411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607596.112290:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.112299:0:16411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607596.112306:0:16411:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d77c419c000 10000000:01000000:2.0:1789607596.112310:0:16411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607596.112313:0:16411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d77c419c000 10000000:01000000:2.0:1789607596.112315:0:16411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789607596.112317:0:16411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d77c419c000 from 1 10000000:01000000:2.0:1789607596.112319:0:16411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789607596.112334:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.112341:0:16411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.112347:0:16411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.112367:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607596.112451:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.112570:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.112601:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081280 00000100:00100000:1.0:1789607596.112605:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081280 00000100:00100000:1.0:1789607596.112660:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607596.112668:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+6:16411:x1876539150081280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607596.112674:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607596.112684:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9184200/0xa26202d240fbe6b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe6aa expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.112700:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9184200/0xa26202d240fbe6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe6aa expref: 7 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.112708:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9184200/0xa26202d240fbe6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe6aa expref: 7 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.112715:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184200, rc 0) 00000100:00100000:1.0:1789607596.112765:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+7:16411:x1876539150081280:12345-0@lo:101:mount.lustre.0 Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.112771:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607596.112840:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607596.112851:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.112881:0:16411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607596.112894:0:16411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789607596.112912:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.112919:0:16411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607596.112936:0:16411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789607596.112940:0:16411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607596.112944:0:16411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d77c419c000 10000000:01000000:0.0:1789607596.112947:0:16411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789607596.112950:0:16411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789607596.112952:0:16411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607596.112968:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.112975:0:16411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.112982:0:16411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607596.112995:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607596.113022:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607596.113038:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607596.113228:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081408 00000100:00100000:3.0:1789607596.113233:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081408 00000100:00100000:3.0:1789607596.113264:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607596.113270:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+7:16411:x1876539150081408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607596.113276:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607596.113284:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbe6bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe6b8 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.113297:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbe6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe6b8 expref: 8 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.113304:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbe6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe6b8 expref: 8 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.113310:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571fe00, rc 0) 00000100:00100000:3.0:1789607596.113341:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+8:16411:x1876539150081408:12345-0@lo:101:mount.lustre.0 Request processed in 71us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607596.113344:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607596.113721:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607596.113878:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.113889:0:16411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607596.113941:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607596.113975:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607596.114029:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.114242:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081536 00000100:00100000:1.0:1789607596.114248:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081536 00000100:00100000:1.0:1789607596.114280:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607596.114287:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+8:16411:x1876539150081536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607596.114682:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16411:x1876539150081536:12345-0@lo:501:mount.lustre.0 Request processed in 395us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.114743:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607596.114776:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607596.114818:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607596.114842:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081664 00000100:00100000:0.0:1789607596.114846:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081664 00000100:00100000:1.0:1789607596.116439:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607596.116644:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.116675:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607596.116693:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16411:x1876539150081664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607596.117468:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16411:x1876539150081664:12345-0@lo:503:mount.lustre.0 Request processed in 773us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.117477:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607596.118760:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150081664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607596.120529:0:16446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16446:1876539150081792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607596.120622:0:16446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.120665:0:16446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.120693:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081792 00000100:00100000:1.0:1789607596.120701:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081792 00000100:00100000:1.0:1789607596.120755:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607596.120765:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16446:x1876539150081792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607596.121178:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16446:x1876539150081792:12345-0@lo:502:llog_process_th.0 Request processed in 414us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.121186:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607596.121274:0:16446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16446:1876539150081792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607596.121302:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607596.121312:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.121315:0:16446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789607596.121321:0:16446:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789607596.121324:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607596.121338:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d77c4ce19c0) 00000020:00000080:2.0:1789607596.121355:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789607596.121361:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789607596.121423:0:16446:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789607596.121431:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe6cd 00000020:00000080:2.0:1789607596.121628:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789607596.121633:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607596.121636:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.121638:0:16446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789607596.121640:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607596.121644:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.121645:0:16446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789607596.121648:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607596.121662:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d77c4ce3380) 00000020:00000080:2.0:1789607596.121672:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789607596.121676:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789607596.121678:0:16446:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789607596.121681:0:16446:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789607596.121686:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607596.121724:0:16446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c419c000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789607596.121753:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d77c4ce0000) 00000020:00000080:2.0:1789607596.121761:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789607596.121909:0:16446:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789607596.121916:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbe6e2 00000020:00000080:2.0:1789607596.121996:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789607596.122013:0:16446:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789607596.122017:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa26202d240fbe6e9 00080000:01000000:2.0:1789607596.122023:0:16446:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789607596.122025:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe6f0 00010000:00010000:1.0:1789607596.219837:0:16446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789607596.220824:0:16446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1789607596.223249:0:16446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789607596.224479:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d77c4193380) 00000020:00000080:1.0:1789607596.224504:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789607596.224578:0:16446:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789607596.224584:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe6fe 00000020:00000080:1.0:1789607596.225680:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789607596.230129:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa26202d240fbe705 00000020:00000080:0.0:1789607596.237320:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789607596.237337:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607596.237344:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607596.237346:0:16446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789607596.237351:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789607596.237354:0:16446:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789607596.237355:0:16446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789607596.237357:0:16446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789607596.237358:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789607596.237360:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607596.237362:0:16446:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789607596.237365:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607596.237370:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607596.237372:0:16446:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789607596.237376:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789607596.237429:0:16446:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789607596.237450:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607596.237453:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607596.237455:0:16446:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789607596.237463:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607596.237466:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607596.237468:0:16446:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789607596.237595:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789607596.237602:0:16446:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:00000080:0.0:1789607596.237629:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789607596.237646:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d78fd3f19c0) 00000020:00000080:0.0:1789607596.237662:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789607596.237668:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789607596.237720:0:16446:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789607596.237726:0:16446:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789607596.237735:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe713 00010000:00080000:0.0:1789607596.237766:0:16446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78e0e9a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607596.241235:0:16446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789607596.246827:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607596.246843:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789607596.247468:0:16446:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789607596.247490:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbe71a 00000100:00080000:2.0:1789607596.247500:0:16446:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607596.247512:0:16446:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78e0e9a000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607596.247549:0:16446:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4ead80 x1876539150081920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607596.247617:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150081920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607596.247681:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607596.247748:0:16446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789607596.247817:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607596.247822:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.247824:0:16446:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789607596.247828:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607596.247830:0:16446:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789607596.247832:0:16446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607596.247834:0:16446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607596.247835:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607596.247838:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.247855:0:16446:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607596.247881:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607596.247886:0:16446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789607596.247890:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.247891:0:16446:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789607596.247895:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607596.247898:0:16446:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607596.247929:0:16446:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789607596.247933:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607596.247959:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d78ef164d40) 00000020:00000080:2.0:1789607596.247972:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789607596.247987:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1789607596.248133:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150081920 00000100:00100000:3.0:1789607596.248149:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150081920 00000100:00100000:3.0:1789607596.248178:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607596.248186:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150081920:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789607596.248201:0:16433:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:2.0:1789607596.250712:0:16446:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789607596.250721:0:16446:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789607596.250735:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe728 00010000:00080000:2.0:1789607596.250791:0:16446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78f567f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607596.251196:0:16446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789607596.251732:0:16446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789607596.251780:0:16446:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789607596.253226:0:16446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607596.253587:0:16446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789607596.253681:0:16446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789607596.254074:0:16452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789607596.254080:0:16452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789607596.255129:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607596.255151:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789607596.255183:0:16446:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789607596.255206:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbe72f 00000100:00080000:2.0:1789607596.255218:0:16446:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607596.255229:0:16446:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78f567f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607596.255264:0:16446:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4e9f80 x1876539150082048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607596.255480:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150082048:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789607596.255529:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150082048 offset 0 length 520: 4 00000100:00080000:2.0:1789607596.255599:0:16446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789607596.255663:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607596.255667:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.255669:0:16446:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789607596.255673:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607596.255675:0:16446:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789607596.255677:0:16446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607596.255678:0:16446:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607596.255680:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607596.255682:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.255684:0:16446:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607596.255686:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607596.255690:0:16446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789607596.255694:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.255695:0:16446:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789607596.255699:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607596.255702:0:16446:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607596.255722:0:16446:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789607596.255724:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607596.255736:0:16446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d78ef1619c0) 00000020:00000080:2.0:1789607596.255748:0:16446:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789607596.255752:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607596.255807:0:16446:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789607596.255812:0:16446:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789607596.255817:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbe73d 00010000:00080000:2.0:1789607596.255842:0:16446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78f567f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607596.256098:0:16446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789607596.256510:0:16446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789607596.256531:0:16446:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789607596.257555:0:16446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607596.257632:0:16446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789607596.257717:0:16446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789607596.258485:0:16454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789607596.258491:0:16454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789607596.259445:0:16446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607596.259456:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789607596.259483:0:16446:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789607596.259500:0:16446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbe744 00000100:00080000:2.0:1789607596.259510:0:16446:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607596.259521:0:16446:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607596.259557:0:16446:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4e8000 x1876539150082176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607596.259612:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150082176:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789607596.259672:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150082176 offset 0 length 520: 4 00000100:00080000:2.0:1789607596.259722:0:16446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789607596.259795:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607596.259799:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.259801:0:16446:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789607596.259803:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607596.259806:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.259808:0:16446:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607596.259810:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607596.259812:0:16446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789607596.259814:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607596.259816:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.259817:0:16446:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789607596.259819:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607596.259821:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607596.259822:0:16446:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789607596.259825:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789607596.259850:0:16446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16446:1876539150082304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607596.259909:0:16446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.259929:0:16446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.260918:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150082304 00000100:00100000:1.0:1789607596.260928:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150082304 00000100:00100000:1.0:1789607596.260980:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607596.260989:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16446:x1876539150082304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607596.261511:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16446:x1876539150082304:12345-0@lo:502:llog_process_th.0 Request processed in 522us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.261519:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607596.261637:0:16446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16446:1876539150082304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607596.261666:0:16446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607596.261672:0:16446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607596.261674:0:16446:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789607596.261678:0:16446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789607596.261834:0:16411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789607596.261853:0:16411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789607596.261968:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.261988:0:16411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607596.261997:0:16411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c419c000 from 1 10000000:01000000:2.0:1789607596.262000:0:16411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607596.262110:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.262118:0:16411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.262126:0:16411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.262155:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607596.262190:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.262227:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.262294:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150082432 00000100:00100000:0.0:1789607596.262300:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150082432 00000100:00100000:0.0:1789607596.262359:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607596.262367:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+9:16411:x1876539150082432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607596.262376:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607596.262391:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe74b expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.262412:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe74b expref: 10 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.262431:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe74b expref: 10 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.262440:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:0.0:1789607596.262475:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+10:16411:x1876539150082432:12345-0@lo:101:mount.lustre.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.262482:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607596.262837:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607596.262852:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.262888:0:16411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.263583:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082560:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789607596.263630:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.263653:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.263887:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150082560 00000100:00100000:0.0:1789607596.263894:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150082560 00000100:00100000:0.0:1789607596.263927:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607596.263936:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+10:16411:x1876539150082560:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789607596.263957:0:16421:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789607596.263964:0:16421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789607596.264106:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+10:16411:x1876539150082560:12345-0@lo:256:mount.lustre.0 Request processed in 171us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.264114:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607596.264209:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082560:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789607596.266189:0:16411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607596.266213:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.266227:0:16411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607596.266237:0:16411:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c419c000 from 1 10000000:01000000:2.0:1789607596.266240:0:16411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607596.266381:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.266390:0:16411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.266402:0:16411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.266425:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607596.266490:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.266531:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607596.266735:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150082688 00000100:00100000:2.0:1789607596.266742:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150082688 00000100:00100000:2.0:1789607596.266842:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607596.266851:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+10:16411:x1876539150082688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607596.266878:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607596.266893:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe759 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.266931:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe759 expref: 11 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.266941:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe759 expref: 11 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.266950:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581e00, rc 0) 00000100:00100000:2.0:1789607596.266989:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150082688:12345-0@lo:101:mount.lustre.0 Request processed in 139us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607596.266996:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607596.267234:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607596.267248:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607596.267257:0:16411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607596.267448:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607596.267478:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607596.267541:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.267585:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150082816 00000100:00100000:1.0:1789607596.267590:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150082816 00000100:00100000:1.0:1789607596.267652:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607596.267661:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150082816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607596.268490:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150082816:12345-0@lo:501:mount.lustre.0 Request processed in 826us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607596.268499:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607596.268568:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607596.268609:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607596.268654:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607596.268725:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607596.268761:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150082944 00000100:00100000:2.0:1789607596.268767:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150082944 00000100:00100000:2.0:1789607596.268831:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607596.268840:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150082944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607596.269038:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150082944:12345-0@lo:503:mount.lustre.0 Request processed in 198us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607596.269045:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607596.269132:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150082944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607596.269389:0:16456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16456:1876539150083072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607596.269428:0:16456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607596.269756:0:16456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.269792:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083072 00000100:00100000:0.0:1789607596.269798:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083072 00000100:00100000:0.0:1789607596.269823:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607596.269830:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16456:x1876539150083072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607596.270545:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16456:x1876539150083072:12345-0@lo:502:llog_process_th.0 Request processed in 713us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.270559:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607596.270628:0:16456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16456:1876539150083072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607596.270658:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607596.270667:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.270670:0:16456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789607596.270678:0:16456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c419c000 00000020:00000080:1.0:1789607596.270682:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607596.270688:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607596.270691:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.270692:0:16456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789607596.270701:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607596.270704:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.270705:0:16456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789607596.270709:0:16456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c419c000 00000020:00000080:1.0:1789607596.270710:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607596.270803:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607596.270808:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.270809:0:16456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789607596.270812:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607596.270814:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.270816:0:16456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607596.270820:0:16456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c419c000 00000020:00000080:1.0:1789607596.270822:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607596.275455:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607596.275467:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.275469:0:16456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607596.275475:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607596.275478:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.275480:0:16456:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789607596.275485:0:16456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c419c000 00000020:00000080:1.0:1789607596.275487:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789607596.275568:0:16456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16456:1876539150083200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607596.275648:0:16456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607596.275703:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083200 00000100:00100000:1.0:1789607596.275711:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083200 00000100:00100000:1.0:1789607596.275765:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607596.275774:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16456:x1876539150083200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607596.277386:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16456:x1876539150083200:12345-0@lo:502:llog_process_th.0 Request processed in 1607us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.277399:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607596.277471:0:16456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.277504:0:16456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16456:1876539150083200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607596.277540:0:16456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607596.277546:0:16456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607596.277548:0:16456:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789607596.277553:0:16456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789607596.277624:0:16411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789607596.277646:0:16411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607596.277662:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.277673:0:16411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607596.277722:0:16411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789607596.277725:0:16411:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d77c419c000 10000000:01000000:1.0:1789607596.277728:0:16411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d77c419c000 10000000:01000000:1.0:1789607596.277731:0:16411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607596.277737:0:16411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d77c419c000 from 1 10000000:01000000:1.0:1789607596.277740:0:16411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607596.277771:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.277779:0:16411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.277788:0:16411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607596.277806:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150083328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607596.277855:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607596.277910:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.278193:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083328 00000100:00100000:0.0:1789607596.278200:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083328 00000100:00100000:0.0:1789607596.278245:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607596.278255:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150083328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607596.278267:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607596.278289:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbe76e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe767 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.278420:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbe76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe767 expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.278431:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbe76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe767 expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.278439:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9e00, rc 0) 00000100:00100000:0.0:1789607596.278476:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16411:x1876539150083328:12345-0@lo:101:mount.lustre.0 Request processed in 224us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.278482:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607596.279445:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150083328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607596.279469:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607596.279480:0:16411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607596.279542:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150083456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607596.279585:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607596.279615:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.279632:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083456 00000100:00100000:1.0:1789607596.279637:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083456 00000100:00100000:1.0:1789607596.279676:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607596.279684:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78dbe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16411:x1876539150083456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607596.279941:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78dbe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16411:x1876539150083456:12345-0@lo:501:mount.lustre.0 Request processed in 258us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.279948:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607596.279987:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150083456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607596.282124:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150083584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607596.282212:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607596.282249:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.282271:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083584 00000100:00100000:1.0:1789607596.282278:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083584 00000100:00100000:1.0:1789607596.283430:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607596.283446:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16411:x1876539150083584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607596.283464:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150081920:12345-0@lo:38:llog_process_th.0 Request processed in 35275us (35780us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789607596.283476:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789607596.283545:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607596.283551:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607596.283555:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150081920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607596.283671:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16411:x1876539150083584:12345-0@lo:503:mount.lustre.0 Request processed in 230us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607596.283679:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789607596.283784:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150083584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607596.288550:0:16459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16459:1876539150083712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607596.288647:0:16459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607596.288689:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083712 00000100:00100000:3.0:1789607596.288695:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083712 00000100:00100000:3.0:1789607596.288739:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789607596.288748:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16459:x1876539150083712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607596.288993:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16459:x1876539150083712:12345-0@lo:502:llog_process_th.0 Request processed in 246us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607596.289001:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789607596.289048:0:16459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9daa180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607596.289068:0:16459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16459:1876539150083712:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789607596.289265:0:16459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789607596.289282:0:16459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d78f12b0000) 00000020:00000080:3.0:1789607596.289305:0:16459:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789607596.289387:0:16459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c419c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789607596.289391:0:16459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c419c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789607596.289394:0:16459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c419c000 4 00010000:00080000:3.0:1789607596.289422:0:16459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7900371800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1789607596.294371:0:16459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789607596.294782:0:16459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789607596.294832:0:16459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789607596.294845:0:16459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa26202d240fbe77c 00000100:00080000:3.0:1789607596.294923:0:16459:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607596.294936:0:16459:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d7900371800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607596.294970:0:16459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0700a80 x1876539150083840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607596.295014:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150083840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607596.295153:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607596.295242:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083840 00000100:00100000:3.0:1789607596.295250:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083840 00000100:00100000:3.0:1789607596.295283:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607596.295290:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150083840:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607596.295342:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150083840:12345-0@lo:38:llog_process_th.0 Request processed in 51us (189us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789607596.295350:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607596.295384:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607596.295392:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7900371800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607596.295408:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789607596.295412:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150083840:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789607596.295445:0:16459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607596.297251:0:16459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16459:1876539150083968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607596.297934:0:16459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607596.297978:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150083968 00000100:00100000:3.0:1789607596.297985:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150083968 00000100:00100000:3.0:1789607596.298025:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789607596.298033:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16459:x1876539150083968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607596.299019:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16459:x1876539150083968:12345-0@lo:502:llog_process_th.0 Request processed in 983us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607596.299169:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607596.300114:0:16459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9daae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607596.300161:0:16459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16459:1876539150083968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607596.300231:0:16459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16459:1876539150084096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607596.300396:0:16459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607596.300439:0:16459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58780 going to sleep for 11 seconds 00000100:00100000:1.0:1789607596.303147:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084096 00000100:00100000:1.0:1789607596.303160:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084096 00000100:00100000:1.0:1789607596.303226:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607596.303243:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d79020c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16459:x1876539150084096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607596.303501:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d79020c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16459:x1876539150084096:12345-0@lo:502:llog_process_th.0 Request processed in 266us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607596.304711:0:16459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16459:1876539150084096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789607596.304752:0:16459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1789607596.309697:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000000:3.0:1789607596.309934:0:16411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789607596.309970:0:16411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607596.309988:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.310000:0:16411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607596.310124:0:16411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607596.310126:0:16411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607596.310128:0:16411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607596.310129:0:16411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607596.310130:0:16411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607596.310131:0:16411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607596.310133:0:16411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607596.310134:0:16411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607596.310145:0:16411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607596.310147:0:16411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607596.310151:0:16411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789607596.310154:0:16411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607596.310155:0:16411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607596.310156:0:16411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607596.310157:0:16411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607596.310158:0:16411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607596.310159:0:16411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607596.310161:0:16411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607596.310161:0:16411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607596.310162:0:16411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607596.310163:0:16411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607596.310188:0:16411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789607596.310206:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150084224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607596.310269:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607596.310315:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084224 00000100:00100000:1.0:1789607596.310322:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084224 00000100:00100000:1.0:1789607596.310360:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607596.310369:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d277b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16411:x1876539150084224:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607596.310404:0:16423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789607596.310419:0:16423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789607596.310440:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0d1c0c0 going to sleep for 11 seconds 20000000:01000000:3.0:1789607596.379289:0:16423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789607596.379310:0:16423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789607596.379392:0:16444:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789607596.379397:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789607596.379420:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.379439:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe74b expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.379448:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.379622:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe74b expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607596.379640:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe74b expref: 12 pid: 16421 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607596.379655:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150084352:0@lo:104: 00000100:00100000:0.0:1789607596.379719:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607596.379776:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607596.379932:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084352 00000100:00100000:3.0:1789607596.379941:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084352 00000100:00100000:3.0:1789607596.379991:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607596.380001:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150084352:12345-0@lo:104: 00010000:00010000:3.0:1789607596.380014:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380080:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607596.380086:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150084352:12345-0@lo:104: Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607596.380093:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789607596.380114:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607596.380119:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380125:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607596.380129:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380147:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607596.380154:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607596.380160:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607596.380196:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380221:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607596.380241:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380248:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd581200/0xa26202d240fbe74b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe752 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380265:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607596.380267:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607596.380269:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607596.380300:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150084480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607596.380330:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607596.380384:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084480 00000100:00100000:3.0:1789607596.380389:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084480 00010000:00010000:3.0:1789607596.380404:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe74b expref: 13 pid: 16421 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607596.380425:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607596.380432:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+13:3468:x1876539150084480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607596.380441:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607596.380447:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe74b expref: 13 pid: 16421 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380457:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe74b expref: 13 pid: 16421 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380472:0:16414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380703:0:16414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607596.380718:0:16414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001321896s 00010000:00010000:3.0:1789607596.380724:0:16414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380730:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380811:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380821:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380826:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607596.380831:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380838:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380846:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.380856:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607596.380919:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+13:3468:x1876539150084480:12345-0@lo:103:ldlm_bl.0 Request processed in 486us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607596.380926:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607596.380978:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150084480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607596.381008:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe74b expref: 12 pid: 16421 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607596.381018:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150084352:0@lo:104: 00010000:00010000:3.0:1789607596.381033:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.381041:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.381047:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607596.381053:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef9800/0xa26202d240fbe783 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607596.390812:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d277b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16411:x1876539150084224:12345-0@lo:253:mount.lustre.0 Request processed in 80435us (80532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607596.390840:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607596.390883:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16411:1876539150084224:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789607596.390898:0:16411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789607596.390901:0:16411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607596.390903:0:16411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789607596.390905:0:16411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607596.390906:0:16411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607596.390908:0:16411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607596.390909:0:16411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607596.390910:0:16411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607596.390912:0:16411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789607596.390914:0:16411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607596.390915:0:16411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789607596.390929:0:16411:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789607596.396853:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607596.397001:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607596.397289:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607596.397459:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607596.398004:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607596.398308:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607596.399085:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607596.399342:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607596.399618:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607596.399837:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607596.400159:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607596.400390:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789607596.427816:0:16411:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789607596.428575:0:16411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789607596.428582:0:16469:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789607596.428586:0:16469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789607596.429287:0:16470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789607596.429391:0:16470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607596.431464:0:16470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789607596.431555:0:16470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1789607596.432970:0:16411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789607596.433559:0:16471:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d78fd114e00 x1876539150084608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607596.433572:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00000040:01000000:0.0:1789607596.438483:0:16411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789607596.438657:0:16411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789607596.439220:0:16411:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789607596.439228:0:16411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789607596.439371:0:16411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607596.440743:0:16411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789607596.446636:0:16411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789607596.446713:0:16411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789607596.451030:0:16411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789607596.459060:0:16411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789607596.526383:0:16411:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789607596.526419:0:16411:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa81b01d1f988 00100000:10000000:0.0:1789607596.526427:0:16411:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789607596.528260:0:16411:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789607596.528277:0:16411:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789607596.528295:0:16411:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789607596.528312:0:16411:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789607596.964487:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607597.347536:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607597.347544:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c419c000 from 7 10000000:01000000:1.0:1789607597.347549:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607597.347598:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.347610:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.347622:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607597.347658:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150084736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607597.347726:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607597.347772:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0d1c6c0 going to sleep for 11 seconds 00000040:00080000:1.0:1789607597.348460:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789607597.348570:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084736 00000100:00100000:1.0:1789607597.348577:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084736 00000100:00100000:1.0:1789607597.348623:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607597.348632:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+11:16427:x1876539150084736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607597.348647:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607597.348675:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe78a expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.348698:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe78a expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.348710:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe78a expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.348718:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:1.0:1789607597.348777:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16427:x1876539150084736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607597.348794:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607597.348841:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150084736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607597.348858:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.348886:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607597.348939:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150084864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607597.348972:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607597.348990:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0d1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607597.349003:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084864 00000100:00100000:1.0:1789607597.349007:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084864 00000100:00100000:1.0:1789607597.349029:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607597.349035:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d277b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16427:x1876539150084864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789607597.349048:0:16423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789607597.349064:0:16423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789607597.349067:0:16423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789607597.349159:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d277b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:16427:x1876539150084864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607597.349166:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607597.349196:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150084864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607597.349233:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607597.349239:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607597.349257:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607597.474474:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607597.986088:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607598.370844:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607598.498135:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:2.0:1789607599.016760:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607599.530943:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607600.037515:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607600.547520:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00000001:02000400:3.0:1789607600.700855:0:16713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789607601.058000:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607601.379177:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789607601.379185:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789607601.379188:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607601.379196:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:1.0:1789607601.379202:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789607601.379213:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78e0e9a000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607601.379236:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd117480 x1876539150085120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607601.379253:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607601.379257:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607601.379260:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607601.379262:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607601.379265:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789607601.379279:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789607601.379281:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d7900371800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607601.379286:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d7900371800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607601.379299:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd116300 x1876539150085248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607601.379332:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085120:0@lo:38:kworker.0 00000100:00100000:1.0:1789607601.379435:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607601.379480:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150085248:0@lo:38:kworker.0 00000100:00100000:1.0:1789607601.379507:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607601.379555:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150085120 00000100:00100000:1.0:1789607601.379562:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150085120 00000100:00100000:1.0:1789607601.379589:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607601.379596:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150085120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789607601.379612:0:16434:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789607601.380320:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150084992:0@lo:400:kworker.0 00000100:00100000:3.0:1789607601.380364:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607601.381041:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084992 00000100:00100000:0.0:1789607601.381060:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084992 00000100:00100000:0.0:1789607601.381117:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607601.381125:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:3469:x1876539150084992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607601.381183:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:3469:x1876539150084992:12345-0@lo:400:kworker.0 Request processed in 59us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607601.381190:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607601.381403:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150084992:0@lo:400:kworker.0 00000100:00100000:3.0:1789607601.382002:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150085248 00000100:00100000:3.0:1789607601.382009:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150085248 00000100:00100000:3.0:1789607601.382037:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607601.382043:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150085248:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789607601.384183:0:16430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1789607601.384231:0:16430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa26202d240fbe798 00000004:00100000:3.0:1789607601.384247:0:16430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607601.384436:0:16430:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd6d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607601.384538:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3467:x1876539150085248:12345-0@lo:38:kworker.0 Request processed in 2493us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607601.384548:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789607601.392130:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78fd116300 x1876539150085248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607601.392150:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789607601.392159:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789607601.392164:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789607601.392167:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7900371800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789607601.392174:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150085248:0@lo:38:kworker.0 00000100:00100000:1.0:1789607601.414646:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150085120:12345-0@lo:38:kworker.0 Request processed in 35036us (35197us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607601.414667:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789607601.417157:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607601.417169:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607601.417175:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085120:0@lo:38:kworker.0 00000100:00100000:0.0:1789607601.569994:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607602.082044:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607602.593929:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:1.0:1789607603.106747:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607603.628321:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607604.130636:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607604.642733:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:1.0:1789607605.161648:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607605.666896:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607606.179193:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607606.498014:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607596/real 1789607596] req@ffff8d78fd4e8000 x1876539150082176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607606.498059:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fd4e8000 x1876539150082176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607606.498086:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607596/real 1789607596] req@ffff8d78fd4e9f80 x1876539150082048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607606.498100:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fd4e9f80 x1876539150082048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789607606.498121:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607606.498140:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:0.0:1789607606.498147:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789607606.498154:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789607606.498158:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607606.498166:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1789607606.498173:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789607606.498208:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78e0e9a000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607606.498212:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150085376:0@lo:400:kworker.0 00000100:00100000:0.0:1789607606.498239:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd80700 x1876539150085504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607606.498252:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607606.498256:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607606.498259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607606.498263:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607606.498264:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607606.498268:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:0.0:1789607606.498271:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607606.498277:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607606.498291:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd82680 x1876539150085632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607606.498301:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607606.498323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607606.498327:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607606.498366:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607606.498370:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150085376 00000100:00100000:1.0:1789607606.498375:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150085760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607606.498380:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150085376 00000100:00100000:1.0:1789607606.498409:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607606.498468:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789607606.498479:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:3470:x1876539150085376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607606.498545:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:3470:x1876539150085376:12345-0@lo:400:kworker.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607606.498552:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607606.498580:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150082176:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789607606.498587:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150085376:0@lo:400:kworker.0 00000100:00080000:2.0:1789607606.498590:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607606.498606:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789607606.498611:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150082048:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789607606.498645:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085504:0@lo:38:kworker.0 00000100:00100000:2.0:1789607606.498686:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607606.498717:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085632:0@lo:8:kworker.0 00000100:00100000:1.0:1789607606.498732:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150085504 00000100:00100000:1.0:1789607606.498739:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150085504 00000400:00000100:2.0:1789607606.498744:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150085632 offset 0 length 520: 4 00000100:00100000:1.0:1789607606.498771:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607606.498778:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150085504:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789607606.498804:0:16433:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789607606.498838:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150085760 00000100:00100000:3.0:1789607606.498844:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150085760 00000100:00100000:3.0:1789607606.498897:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607606.498905:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150085760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607606.498953:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150085760:12345-0@lo:400:kworker.0 Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607606.498961:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789607606.499007:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607606.499010:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789607606.499019:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607606.499023:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1789607606.499026:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789607606.499032:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78f567f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607606.499050:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0703800 x1876539150085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607606.499140:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085888:0@lo:8:kworker.0 00000400:00000100:2.0:1789607606.499180:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150085888 offset 0 length 520: 4 00010000:00080000:0.0:1789607606.499299:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78fcd82a00 x1876539150085760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607606.499325:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150085760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607606.511047:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150085504:12345-0@lo:38:kworker.0 Request processed in 12252us (12344us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607606.511077:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789607606.511301:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607606.511308:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607606.511314:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085504:0@lo:38:kworker.0 00000100:00100000:2.0:1789607606.691550:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00000020:01000004:2.0:1789607607.091979:0:17063:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607607.091984:0:17063:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:2.0:1789607607.092157:0:17063:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d78d9435000 00000020:01000004:2.0:1789607607.093963:0:17063:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789607607.093983:0:17063:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607607.094008:0:17063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d78ef163380) 00000020:00000080:2.0:1789607607.094034:0:17063:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789607607.122650:0:17063:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789607607.124257:0:17063:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789607607.133030:0:17063:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1789607607.133694:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 455: rc = 0 00100000:10000000:2.0:1789607607.133793:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 455: rc = 0 00100000:10000000:2.0:1789607607.133907:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 455: rc = 0 00100000:10000000:2.0:1789607607.134479:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607607.134785:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 568: rc = 0 00100000:10000000:2.0:1789607607.136224:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 568: rc = 0 00100000:10000000:2.0:1789607607.136546:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 568: rc = 0 00100000:10000000:2.0:1789607607.140514:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607607.141216:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607607.141819:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607607.142280:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 568: rc = 0 00100000:10000000:2.0:1789607607.142557:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607607.143654:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 568: rc = 0 00100000:10000000:2.0:1789607607.144170:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 568: rc = 0 00100000:10000000:2.0:1789607607.144651:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607607.149590:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 774: rc = 0 00100000:10000000:2.0:1789607607.149909:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 774: rc = 0 00100000:10000000:2.0:1789607607.151541:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 774: rc = 0 00100000:10000000:2.0:1789607607.152796:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 774: rc = 0 00100000:10000000:2.0:1789607607.154365:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 774: rc = 0 00100000:10000000:2.0:1789607607.154714:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 774: rc = 0 00100000:10000000:2.0:1789607607.155031:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 774: rc = 0 00100000:10000000:2.0:1789607607.160781:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 774: rc = 0 00100000:10000000:3.0:1789607607.161293:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 774: rc = 0 00100000:10000000:3.0:1789607607.161580:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 774: rc = 0 00100000:10000000:3.0:1789607607.161853:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 774: rc = 0 00100000:10000000:3.0:1789607607.162189:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 774: rc = 0 00100000:10000000:3.0:1789607607.162496:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 774: rc = 0 00100000:10000000:3.0:1789607607.168919:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 774: rc = 0 00100000:10000000:3.0:1789607607.170741:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 774: rc = 0 00100000:10000000:3.0:1789607607.171651:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 774: rc = 0 00100000:10000000:3.0:1789607607.172009:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 774: rc = 0 00100000:10000000:3.0:1789607607.172296:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 774: rc = 0 00100000:10000000:3.0:1789607607.172843:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 774: rc = 0 00100000:10000000:3.0:1789607607.173931:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 774: rc = 0 00100000:10000000:3.0:1789607607.174264:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 774: rc = 0 00100000:10000000:3.0:1789607607.177250:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 774: rc = 0 00100000:10000000:3.0:1789607607.177957:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 774: rc = 0 00100000:10000000:3.0:1789607607.179383:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 774: rc = 0 00100000:10000000:3.0:1789607607.179804:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 774: rc = 0 00100000:10000000:3.0:1789607607.180275:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 774: rc = 0 00100000:10000000:3.0:1789607607.180605:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 774: rc = 0 00100000:10000000:3.0:1789607607.180855:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 774: rc = 0 00100000:10000000:3.0:1789607607.181467:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 774: rc = 0 00100000:10000000:3.0:1789607607.182797:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 774: rc = 0 00100000:10000000:3.0:1789607607.183828:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 774: rc = 0 00100000:10000000:3.0:1789607607.184193:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 774: rc = 0 00100000:10000000:3.0:1789607607.184684:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 576: rc = 0 00100000:10000000:3.0:1789607607.185326:0:17063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 576: rc = 0 00000020:00000080:3.0:1789607607.187687:0:17063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789607607.187702:0:17063:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607607.187716:0:17063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbe7a6 00000020:01000004:3.0:1789607607.187728:0:17063:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:3.0:1789607607.187766:0:17063:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789607607.187770:0:17063:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789607607.187777:0:17063:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789607607.187805:0:17063:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:3.0:1789607607.187811:0:17063:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:0.0:1789607607.203499:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789607607.206393:0:17063:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789607607.206446:0:17063:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789607607.206451:0:17063:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789607607.206453:0:17063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607607.206455:0:17063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607607.206456:0:17063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607607.206457:0:17063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607607.206459:0:17063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607607.206460:0:17063:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607607.206463:0:17063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607607.206464:0:17063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789607607.206469:0:17063:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789607607.206471:0:17063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789607607.206473:0:17063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607607.206474:0:17063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607607.206476:0:17063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607607.206477:0:17063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607607.206478:0:17063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607607.206479:0:17063:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607607.206480:0:17063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607607.206481:0:17063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789607607.206531:0:17063:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789607607.206560:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789607607.206660:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.206987:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607607.207200:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086016 00000100:00100000:3.0:1789607607.207210:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086016 00000100:00100000:2.0:1789607607.207499:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607607.207512:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:17063:x1876539150086016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789607607.207574:0:16423:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789607607.207578:0:16423:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789607607.207587:0:16423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789607607.220275:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:17063:x1876539150086016:12345-0@lo:253:mount.lustre.0 Request processed in 12752us (13601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.220293:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607607.221232:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789607607.221254:0:17063:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789607607.221257:0:17063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789607607.221259:0:17063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607607.221279:0:17063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607607.221281:0:17063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607607.221282:0:17063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607607.221283:0:17063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607607.221285:0:17063:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607607.221287:0:17063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607607.221289:0:17063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789607607.221317:0:17063:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d78d9435000 from lustre-MDT0001 10000000:01000000:1.0:1789607607.221357:0:17063:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789607607.221360:0:17063:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789607607.221369:0:17063:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78fd3f3380 local copy 00010000:00010000:1.0:1789607607.221383:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607607.222510:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607607.222595:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.222661:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194240 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.222787:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086144 00000100:00100000:0.0:1789607607.222798:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086144 00000100:00100000:0.0:1789607607.222903:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607607.222916:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:17063:x1876539150086144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607607.223162:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:17063:x1876539150086144:12345-0@lo:501:mount.lustre.0 Request processed in 249us (567us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607607.223172:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607607.223672:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086144:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789607607.223696:0:17063:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789607607.223930:0:17063:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789607607.223941:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.223965:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.224006:0:17063:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78d9435000 10000000:01000000:3.0:1789607607.224012:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789607607.224018:0:17063:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d78fd3f3380 10000000:01000000:3.0:1789607607.224021:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789607607.224025:0:17063:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d78fd3f3380 from 1 10000000:01000000:3.0:1789607607.224028:0:17063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789607607.224085:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.224095:0:17063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.224107:0:17063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607607.224130:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607607.224193:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.224358:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f64030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.226698:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086272 00000100:00100000:2.0:1789607607.226718:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086272 00000100:00100000:2.0:1789607607.226797:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789607607.226810:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+12:17063:x1876539150086272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607607.226833:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607607.226858:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580c00/0xa26202d240fbe7b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe7ad expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.227009:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580c00/0xa26202d240fbe7b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe7ad expref: 13 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.227022:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580c00/0xa26202d240fbe7b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe7ad expref: 13 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.227055:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580c00, rc 0) 00000100:00100000:2.0:1789607607.227170:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+13:17063:x1876539150086272:12345-0@lo:101:mount.lustre.0 Request processed in 362us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.227177:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607607.227505:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607607.227528:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.227539:0:17063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.227582:0:17063:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789607607.227648:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.227657:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.227670:0:17063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d78d9435000 10000000:01000000:3.0:1789607607.227677:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789607607.227683:0:17063:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d78d9435000 from 1 10000000:01000000:3.0:1789607607.227686:0:17063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789607607.227719:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.227728:0:17063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.227737:0:17063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607607.227761:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607607.227804:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.227847:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f64030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.227932:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086400 00000100:00100000:0.0:1789607607.227939:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086400 00000100:00100000:0.0:1789607607.227986:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607607.227995:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+13:17063:x1876539150086400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607607.228006:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607607.228021:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe7bb expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607607.228040:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe7bb expref: 14 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607607.228049:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe7bb expref: 14 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607607.228065:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:0.0:1789607607.228108:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+14:17063:x1876539150086400:12345-0@lo:101:mount.lustre.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.228124:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607607.228213:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607607.228234:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.228242:0:17063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.228263:0:17063:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789607607.230411:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.230433:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.230443:0:17063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789607607.230454:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607607.230474:0:17063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d78d9435000 10000000:01000000:3.0:1789607607.230478:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789607607.230482:0:17063:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789607607.230485:0:17063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789607607.230530:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.230540:0:17063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.230553:0:17063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607607.230583:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607607.230939:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.230993:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f64030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.232193:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086528 00000100:00100000:2.0:1789607607.232208:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086528 00000100:00100000:2.0:1789607607.232280:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607607.232291:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+14:17063:x1876539150086528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607607.232314:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607607.232336:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd581200/0xa26202d240fbe7d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe7c9 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.232372:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581200/0xa26202d240fbe7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe7c9 expref: 15 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.232385:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd581200/0xa26202d240fbe7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe7c9 expref: 15 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.232395:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581200, rc 0) 00000100:00100000:2.0:1789607607.232487:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086528:12345-0@lo:101:mount.lustre.0 Request processed in 198us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.232495:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607607.232689:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607607.232710:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.232739:0:17063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607607.233680:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789607607.234684:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607607.235047:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789607607.235107:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789607607.235170:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789607607.235210:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789607607.235246:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789607607.235296:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789607607.235335:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789607607.235370:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789607607.235417:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789607607.235454:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789607607.235489:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789607607.235537:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789607607.235573:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789607607.235608:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789607607.235677:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789607607.235714:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789607607.235748:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789607607.235793:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789607607.235828:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789607607.235909:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789607607.235963:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789607607.235998:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789607607.236029:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789607607.237410:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789607607.237429:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789607607.237573:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607607.237674:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.237786:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.237837:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086656 00000100:00100000:2.0:1789607607.237847:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086656 00000100:00100000:2.0:1789607607.238054:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607607.238181:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607607.238709:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086656:12345-0@lo:501:mount.lustre.0 Request processed in 530us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.238950:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607607.239054:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607607.239120:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607607.239174:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.239347:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.239384:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086784 00000100:00100000:0.0:1789607607.239391:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086784 00000100:00100000:0.0:1789607607.239473:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607607.239483:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607607.243151:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086784:12345-0@lo:503:mount.lustre.0 Request processed in 3655us (3962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.243171:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607607.243260:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789607607.244158:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607607.244259:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607607.244334:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607607.244500:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150086912 00000100:00100000:2.0:1789607607.244507:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150086912 00000100:00100000:2.0:1789607607.244552:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607607.244562:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607607.244898:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150086912:12345-0@lo:502:mount.lustre.0 Request processed in 337us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.244905:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607607.245010:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607607.245031:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150086912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607607.245265:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789607607.245312:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789607607.245362:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789607607.245479:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789607607.245516:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789607607.245564:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789607607.245598:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789607607.245628:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789607607.245681:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789607607.245717:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789607607.245749:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789607607.245795:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789607607.245832:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789607607.245891:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789607607.245942:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789607607.245987:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789607607.246021:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789607607.246078:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789607607.246115:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789607607.246166:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789607607.246216:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789607607.246253:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789607607.246288:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789607607.246348:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789607607.246400:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789607607.246434:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789607607.246480:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789607607.246517:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789607607.246553:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789607607.246899:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789607607.246940:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789607607.246975:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789607607.247023:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789607607.247070:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789607607.247106:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789607607.247173:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789607607.247210:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789607607.247246:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789607607.247294:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789607607.247330:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789607607.247366:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789607607.247483:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789607607.247522:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789607607.247560:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789607607.247607:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150087040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607607.247674:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.247794:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f6403000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.247858:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150087040 00000100:00100000:0.0:1789607607.247964:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150087040 00000100:00100000:2.0:1789607607.248120:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607607.248130:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150087040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607607.248410:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150087040:12345-0@lo:502:mount.lustre.0 Request processed in 281us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.248418:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607607.248491:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150087040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607607.248592:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789607607.248602:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789607607.249623:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607607.249635:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.249638:0:17064:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789607607.249642:0:17064:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789607607.249645:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607607.249658:0:17064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d78f12b3380) 00000020:00000080:3.0:1789607607.249679:0:17064:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789607607.249685:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789607607.249758:0:17064:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607607.249766:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbe7de 00000020:00000080:3.0:1789607607.249983:0:17064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789607607.249988:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607607.249991:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.249993:0:17064:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789607607.249996:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607607.249999:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.250000:0:17064:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789607607.250004:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607607.250010:0:17064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d78f12b4d40) 00000020:00000080:3.0:1789607607.250021:0:17064:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789607607.250025:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789607607.250027:0:17064:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789607607.250030:0:17064:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789607607.250036:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789607607.250086:0:17064:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78d9435000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789607607.250104:0:17064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d78f9d28000) 00000020:00000080:3.0:1789607607.250114:0:17064:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789607607.250171:0:17064:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789607607.250177:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbe7f3 00000020:00000080:3.0:1789607607.250273:0:17064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789607607.250280:0:17064:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789607607.250285:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa26202d240fbe7fa 00080000:01000000:3.0:1789607607.250290:0:17064:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789607607.250293:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbe801 00010000:00010000:2.0:1789607607.308525:0:17064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789607607.308998:0:17064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789607607.309222:0:17064:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789607607.313237:0:17064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789607607.313251:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607607.313259:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607607.313261:0:17064:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789607607.313265:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607607.313271:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607607.313273:0:17064:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789607607.313276:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789607607.313282:0:17064:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:00000080:1.0:1789607607.313308:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607607.313324:0:17064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d77c4190000) 00000020:00000080:1.0:1789607607.313348:0:17064:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789607607.313354:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789607607.313422:0:17064:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789607607.313430:0:17064:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789607607.313436:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbe80f 00010000:00080000:1.0:1789607607.313471:0:17064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78fcb58800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607607.315560:0:17064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789607607.316435:0:17064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607607.316447:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789607607.316474:0:17064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789607607.316492:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbe816 00000100:00080000:2.0:1789607607.316502:0:17064:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607607.316514:0:17064:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d78fcb58800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607607.316547:0:17064:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4e8000 x1876539150087168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607607.316608:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150087168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789607607.316669:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.316743:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150087168 00000100:00100000:1.0:1789607607.316750:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150087168 00000100:00100000:1.0:1789607607.316780:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607607.316788:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150087168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789607607.316810:0:16434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1789607607.316845:0:16434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbe81d 00000004:00100000:1.0:1789607607.316859:0:16434:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789607607.316886:0:16434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789607607.317155:0:17064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789607607.317223:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607607.317227:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.317229:0:17064:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789607607.317232:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607607.317235:0:17064:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789607607.317236:0:17064:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607607.317238:0:17064:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607607.317240:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607607.317242:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.317244:0:17064:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607607.317247:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607607.317251:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.317252:0:17064:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789607607.317256:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789607607.317286:0:17064:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789607607.317298:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607607.317301:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.317302:0:17064:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789607607.317305:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607607.317306:0:17064:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1789607607.317308:0:17064:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607607.317309:0:17064:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607607.317311:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607607.317313:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.317314:0:17064:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607607.317317:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607607.317320:0:17064:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1789607607.317323:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.317325:0:17064:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789607607.317328:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607607.317332:0:17064:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607607.317350:0:17064:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789607607.317353:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607607.317371:0:17064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d78ef160000) 00000020:00000080:2.0:1789607607.317383:0:17064:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789607607.317388:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607607.317456:0:17064:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789607607.317462:0:17064:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789607607.317468:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbe82b 00010000:00080000:2.0:1789607607.317495:0:17064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78fcb5f800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607607.317718:0:17064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1789607607.318201:0:17064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789607607.318457:0:17064:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1789607607.319166:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789607607.319172:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789607607.319175:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607607.319182:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1789607607.319188:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789607607.319198:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78e0e9a000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607607.319229:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd116d80 x1876539150087296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607607.319250:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607607.319254:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607607.319256:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607607.319259:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607607.319308:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150087424:0@lo:400:kworker.0 00000100:00100000:1.0:1789607607.319365:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.319413:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150087424 00000100:00100000:1.0:1789607607.319425:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150087424 00000100:00100000:1.0:1789607607.319467:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607607.319475:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150087424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607607.319534:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150087424:12345-0@lo:400:kworker.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.319542:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607607.319579:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78fd115c00 x1876539150087424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607607.319592:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150087424:0@lo:400:kworker.0 00000100:00100000:1.0:1789607607.319612:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150087296:0@lo:38:kworker.0 00000100:00100000:1.0:1789607607.319636:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.319662:0:16433:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789607607.319670:0:16433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789607607.319795:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150087296 00000100:00100000:1.0:1789607607.319801:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150087296 00000100:00100000:1.0:1789607607.319893:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607607.319899:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3467:x1876539150087296:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789607607.319944:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3467:x1876539150087296:12345-0@lo:38:kworker.0 Request processed in 43us (306us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789607607.319950:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607607.319970:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607607.319976:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607607.319979:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789607607.319982:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150087296:0@lo:38:kworker.0 00000040:00080000:2.0:1789607607.320445:0:17064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607607.320510:0:17064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789607607.320593:0:17064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789607607.321168:0:17070:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789607607.321173:0:17070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789607607.322416:0:17064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607607.322428:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789607607.322461:0:17064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789607607.322480:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbe832 00000100:00080000:2.0:1789607607.322490:0:17064:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607607.322500:0:17064:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d78fcb5f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607607.322536:0:17064:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4eb480 x1876539150087552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607607.322572:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150087552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789607607.322625:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150087552 offset 0 length 520: 4 00000100:00080000:2.0:1789607607.322671:0:17064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789607607.322695:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607607.322700:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607607.322702:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607607.322705:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789607607.322748:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607607.322752:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.322754:0:17064:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789607607.322757:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607607.322760:0:17064:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789607607.322761:0:17064:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607607.322763:0:17064:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607607.322764:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607607.322766:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.322768:0:17064:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607607.322771:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607607.322774:0:17064:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1789607607.322777:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.322779:0:17064:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789607607.322782:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607607.322785:0:17064:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607607.322804:0:17064:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789607607.322806:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607607.322823:0:17064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d78c5b93380) 00000020:00000080:2.0:1789607607.322835:0:17064:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789607607.322840:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607607.322928:0:17064:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789607607.322934:0:17064:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789607607.322939:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbe840 00010000:00080000:2.0:1789607607.322972:0:17064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78e0099000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607607.323174:0:17064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789607607.323329:0:17064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789607607.323348:0:17064:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789607607.323746:0:17064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607607.323820:0:17064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789607607.323936:0:17064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789607607.326520:0:17072:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789607607.326531:0:17072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789607607.328256:0:17064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607607.328270:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789607607.328305:0:17064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789607607.328326:0:17064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbe847 00000100:00080000:2.0:1789607607.328335:0:17064:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607607.328348:0:17064:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78e0099000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607607.328382:0:17064:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd4e8a80 x1876539150087680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607607.328400:0:17064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789607607.328447:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607607.328451:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.328454:0:17064:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789607607.328457:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607607.328460:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.328461:0:17064:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607607.328464:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607607.328466:0:17064:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789607607.328469:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607607.328471:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.328472:0:17064:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789607607.328474:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607607.328477:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.328478:0:17064:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789607607.328482:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789607607.328547:0:17064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607607.328551:0:17064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607607.328553:0:17064:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789607607.328556:0:17064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:2.0:1789607607.328713:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607607.328718:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607607.328727:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607607.328731:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607607.328799:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150087680:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789607607.328850:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150087680 offset 0 length 520: 4 00000020:01000000:3.0:1789607607.329490:0:17063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789607607.329527:0:17063:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789607607.329541:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.329552:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.329560:0:17063:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78d9435000 from 1 10000000:01000000:3.0:1789607607.329563:0:17063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607607.329591:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.329599:0:17063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.329610:0:17063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607607.329627:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150087808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607607.329668:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.329698:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d944bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.330130:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150087808 00000100:00100000:2.0:1789607607.330138:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150087808 00000100:00100000:2.0:1789607607.330180:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607607.330188:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+15:17063:x1876539150087808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607607.330200:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607607.330213:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe84e expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.330235:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe84e expref: 16 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.330246:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe84e expref: 16 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.330254:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581c00, rc 0) 00000100:00100000:2.0:1789607607.330294:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:17063:x1876539150087808:12345-0@lo:101:mount.lustre.0 Request processed in 107us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.330300:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607607.330942:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150087808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607607.330959:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.330969:0:17063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607607.331532:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150087936:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789607607.332823:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607607.332901:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0ef8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607607.333171:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150087936 00000100:00100000:1.0:1789607607.333179:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150087936 00000100:00100000:1.0:1789607607.333229:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607607.333239:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:17063:x1876539150087936:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789607607.333262:0:16424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789607607.333281:0:16424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789607607.333285:0:16424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789607607.333373:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:17063:x1876539150087936:12345-0@lo:256:mount.lustre.0 Request processed in 135us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.333380:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607607.333423:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150087936:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789607607.334000:0:17063:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607607.334014:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607607.334025:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607607.334102:0:17063:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78d9435000 from 1 10000000:01000000:1.0:1789607607.334107:0:17063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607607.334136:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607607.334144:0:17063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607607.334152:0:17063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607607.334180:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607607.334218:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.334240:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f06a3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.334309:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088064 00000100:00100000:2.0:1789607607.334314:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088064 00000100:00100000:2.0:1789607607.334383:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607607.334391:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:17063:x1876539150088064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607607.334400:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607607.334412:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe85c expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.334432:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe85c expref: 17 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.334442:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe85c expref: 17 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.334450:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580e00, rc 0) 00000100:00100000:2.0:1789607607.334483:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088064:12345-0@lo:101:mount.lustre.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.334492:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607607.334580:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607607.334591:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.334599:0:17063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607607.334741:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607607.334776:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607607.334801:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607607.336503:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0ef8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607607.336553:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088192 00000100:00100000:1.0:1789607607.336562:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088192 00000100:00100000:2.0:1789607607.338158:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789607607.338170:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607607.338411:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088192:12345-0@lo:501:mount.lustre.0 Request processed in 243us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.338419:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789607607.338475:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607607.338523:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607607.338567:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607607.338593:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0ef8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.338608:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088320 00000100:00100000:2.0:1789607607.338614:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088320 00000100:00100000:2.0:1789607607.338637:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789607607.338642:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607607.338782:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088320:12345-0@lo:503:mount.lustre.0 Request processed in 139us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.338792:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607607.339144:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607607.343887:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607607.343978:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.344236:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.344276:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f755d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.344457:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088448 00000100:00100000:2.0:1789607607.344465:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088448 00000100:00100000:2.0:1789607607.344505:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789607607.344513:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607607.344699:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088448:12345-0@lo:502:mount.lustre.0 Request processed in 185us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607607.344716:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789607607.344891:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607607.345156:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789607607.345205:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789607607.345252:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789607607.345288:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789607607.345322:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789607607.345370:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789607607.345407:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789607607.345448:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789607607.345505:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789607607.345547:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789607607.345579:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789607607.345609:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.345651:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.345677:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0cab480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607607.345682:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088576 00000100:00100000:1.0:1789607607.345687:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088576 00000100:00100000:1.0:1789607607.345714:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607607.345721:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607607.346692:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088576:12345-0@lo:502:mount.lustre.0 Request processed in 967us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.346702:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789607607.347688:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607607.347839:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789607607.347853:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00080000:1.0:1789607607.350990:0:16434:0:(import.c:65:import_set_state_nolock()) ffff8d78cfc3a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607607.351150:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539150087168:12345-0@lo:38:llog_process_th.0 Request processed in 34360us (34479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.351161:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607607.351229:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607607.351237:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789607607.351245:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789607607.351250:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607607.351252:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb58800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607607.351263:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150087168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789607607.351483:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150088704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607607.351595:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.351678:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088704 00000100:00100000:0.0:1789607607.351685:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088704 00000100:00100000:0.0:1789607607.351719:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607607.351727:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150088704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607607.351753:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000020:01000000:3.0:1789607607.351775:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1789607607.351791:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150088704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.351797:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607607.351830:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150088704:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789607607.351882:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.351885:0:17075:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789607607.351891:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78d9435000 00000020:00000080:3.0:1789607607.351894:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607607.351901:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607607.351903:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.351905:0:17075:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789607607.351907:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607607.351910:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.351911:0:17075:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789607607.351915:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78d9435000 00000020:00000080:3.0:1789607607.351916:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607607.351973:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607607.351977:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.351978:0:17075:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789607607.351981:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607607.351983:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.351984:0:17075:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789607607.351987:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78d9435000 00000020:00000080:3.0:1789607607.351989:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607607.352005:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607607.352008:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.352008:0:17075:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789607607.352010:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607607.352012:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.352013:0:17075:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789607607.352016:0:17075:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78d9435000 00000020:00000080:3.0:1789607607.352018:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607607.352050:0:17075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607607.352054:0:17075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607607.352066:0:17075:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789607607.352069:0:17075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789607607.352427:0:17063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789607607.352453:0:17063:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607607.352475:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607607.352488:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607607.352526:0:17063:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789607607.352528:0:17063:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78d9435000 10000000:01000000:0.0:1789607607.352537:0:17063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78d9435000 10000000:01000000:0.0:1789607607.352541:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607607.352547:0:17063:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78d9435000 from 1 10000000:01000000:0.0:1789607607.352550:0:17063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607607.352576:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607607.352585:0:17063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607607.352594:0:17063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607607.352609:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607607.352644:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.352678:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607607.352728:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088832 00000100:00100000:3.0:1789607607.352733:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088832 00000100:00100000:3.0:1789607607.352810:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607607.352818:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:17063:x1876539150088832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607607.352828:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607607.352840:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571f400/0xa26202d240fbe871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe86a expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.352895:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571f400/0xa26202d240fbe871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe86a expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.352906:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571f400/0xa26202d240fbe871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe86a expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.352918:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f400, rc 0) 00000100:00100000:3.0:1789607607.352962:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150088832:12345-0@lo:101:mount.lustre.0 Request processed in 145us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607607.352968:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789607607.353152:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607607.353166:0:17063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607607.353181:0:17063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607607.353781:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789607607.354179:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607607.354426:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789607607.354471:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789607607.354506:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789607607.354635:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789607607.354673:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789607607.354720:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789607607.354756:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789607607.354788:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789607607.354843:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789607607.354904:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789607607.354938:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789607607.354986:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789607607.355108:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789607607.355151:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789607607.355198:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789607607.355233:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789607607.355266:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789607607.355311:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789607607.355346:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789607607.355379:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789607607.355425:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789607607.355460:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789607607.355492:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789607607.355615:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789607607.355656:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789607607.355689:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789607607.355749:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789607607.355784:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789607607.355896:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789607607.355907:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789607607.355993:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607607.356128:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.356175:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150088960 00000100:00100000:1.0:1789607607.356182:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150088960 00000100:00100000:1.0:1789607607.356971:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789607607.356983:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150088960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607607.359932:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f06a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607607.360364:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150088960:12345-0@lo:501:mount.lustre.0 Request processed in 3379us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.360375:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789607607.360462:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150088960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607607.360509:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607607.360621:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.360688:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.360722:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089088 00000100:00100000:2.0:1789607607.360729:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089088 00000100:00100000:2.0:1789607607.360807:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607607.360816:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607607.362147:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089088:12345-0@lo:503:mount.lustre.0 Request processed in 1328us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.362147:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607607.362158:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:0.0:1789607607.363317:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607607.363390:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.363447:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.363530:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089216 00000100:00100000:0.0:1789607607.363536:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089216 00000100:00100000:0.0:1789607607.363567:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607607.363581:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.363782:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089216:12345-0@lo:502:mount.lustre.0 Request processed in 202us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.363790:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607607.363840:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.363856:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607607.364189:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789607607.364241:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789607607.364274:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789607607.364321:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789607607.364356:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789607607.364402:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789607607.364435:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789607607.364464:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789607607.364604:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789607607.364639:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789607607.364669:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789607607.364711:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789607607.364744:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789607607.364775:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789607607.364822:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789607607.364857:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789607607.364978:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789607607.365042:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789607607.365180:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789607607.365214:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789607607.365260:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789607607.365294:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789607607.365326:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789607607.365370:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789607607.365413:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789607607.365445:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789607607.365581:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789607607.365622:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789607607.365656:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789607607.365703:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789607607.365738:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789607607.365772:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789607607.365807:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789607607.365964:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789607607.366005:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789607607.366054:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789607607.366100:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789607607.366137:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789607607.366183:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789607607.366215:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789607607.366244:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789607607.366275:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789607607.366321:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789607607.366356:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789607607.366388:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789607607.366654:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789607607.366697:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789607607.366730:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789607607.366798:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.366970:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.367012:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607607.367071:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089344 00000100:00100000:3.0:1789607607.367077:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089344 00000100:00100000:3.0:1789607607.367302:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607607.367312:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607607.367740:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089344:12345-0@lo:502:mount.lustre.0 Request processed in 429us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607607.367749:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607607.370667:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607607.370888:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789607607.370934:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789607607.370971:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.371041:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607607.371087:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089472 00000100:00100000:0.0:1789607607.371093:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089472 00000100:00100000:0.0:1789607607.371134:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607607.371143:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607607.371303:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089472:12345-0@lo:502:mount.lustre.0 Request processed in 160us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.371311:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607607.371356:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.371370:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607607.371443:0:17063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789607607.371452:0:17063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789607607.375434:0:17080:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789607607.375452:0:17080:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d78fd3f4d40) 00000020:00000080:0.0:1789607607.375477:0:17080:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789607607.375556:0:17080:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78d9435000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789607607.375560:0:17080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78d9435000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789607607.375562:0:17080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78d9435000 3 00010000:00080000:0.0:1789607607.375592:0:17080:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78c6359000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607607.378123:0:17080:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789607607.378364:0:17080:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789607607.378398:0:17080:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607607.378411:0:17080:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa26202d240fbe87f 00000100:00080000:0.0:1789607607.378420:0:17080:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607607.378430:0:17080:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d78c6359000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607607.378463:0:17080:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd82d80 x1876539150089600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607607.378498:0:17080:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607607.378525:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607607.378529:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607607.378540:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607607.378543:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607607.378802:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150089600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607607.378885:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.378938:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089600 00000100:00100000:1.0:1789607607.378944:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089600 00000100:00100000:1.0:1789607607.378971:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607607.378978:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150089600:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789607607.378998:0:16430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1789607607.379024:0:16430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa26202d240fbe886 00000004:00100000:1.0:1789607607.379046:0:16430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789607607.379082:0:16430:0:(import.c:65:import_set_state_nolock()) ffff8d78d94bf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607607.379125:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3467:x1876539150089600:12345-0@lo:38:llog_process_th.0 Request processed in 146us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.379132:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789607607.379166:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78fcd82d80 x1876539150089600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607607.379181:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607607.379188:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789607607.379195:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789607607.379199:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607607.379201:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c6359000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607607.379207:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150089600:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789607607.379658:0:17080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789607607.381294:0:17063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789607607.381334:0:17063:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607607.381351:0:17063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607607.381362:0:17063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789607607.381419:0:17063:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789607607.381421:0:17063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607607.381423:0:17063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607607.381424:0:17063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607607.381425:0:17063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607607.381426:0:17063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607607.381427:0:17063:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607607.381429:0:17063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607607.381431:0:17063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607607.381434:0:17063:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789607607.381437:0:17063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789607607.381438:0:17063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607607.381439:0:17063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607607.381440:0:17063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607607.381441:0:17063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607607.381442:0:17063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607607.381446:0:17063:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607607.381447:0:17063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607607.381448:0:17063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607607.381470:0:17063:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789607607.381488:0:17063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789607607.381917:0:17063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.381953:0:17063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f06a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607607.382012:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089728 00000100:00100000:2.0:1789607607.382019:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089728 00000100:00100000:2.0:1789607607.382132:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607607.382146:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17063:x1876539150089728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789607607.382181:0:16421:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789607607.382192:0:16421:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789607607.413608:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789607607.413729:0:16421:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789607607.413746:0:16421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789607607.413831:0:16444:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607607.413837:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607607.413883:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.413903:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe78a expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.413911:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe84e expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.413919:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.413967:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe84e expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.413982:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe84e expref: 18 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607607.413996:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150089856:0@lo:104: 00000100:00100000:2.0:1789607607.414070:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607607.414121:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe78a expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.414129:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe78a expref: 18 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607607.414138:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150089984:0@lo:104: 00000100:00100000:2.0:1789607607.414160:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607607.414370:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fff69a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607607.414423:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089856 00000100:00100000:3.0:1789607607.414431:0:16413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089856 00000100:00100000:3.0:1789607607.414464:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150089984 00000100:00100000:3.0:1789607607.414467:0:16413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150089984 00000100:00100000:3.0:1789607607.414492:0:16413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607607.414500:0:16413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:16444:x1876539150089856:12345-0@lo:104: 00010000:00010000:3.0:1789607607.414514:0:16413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414562:0:16413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607607.414568:0:16413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:16444:x1876539150089856:12345-0@lo:104: Request processed in 70us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607607.414574:0:16413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607607.414589:0:16413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607607.414594:0:16413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150089984:12345-0@lo:104: 00010000:00010000:3.0:1789607607.414601:0:16413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414631:0:16413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607607.414636:0:16413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150089984:12345-0@lo:104: Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607607.414641:0:16413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789607607.414657:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607607.414663:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414670:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607607.414673:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414681:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607607.414699:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.414705:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607607.414738:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414744:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607607.414763:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414770:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571e000/0xa26202d240fbe84e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe855 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414782:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607607.414785:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414791:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607607.414794:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414800:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607607.414806:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607607.414811:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607607.414831:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414838:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607607.414845:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414851:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe78a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe791 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.414881:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607607.414883:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607607.414884:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607607.414894:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150090240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607607.414922:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.414947:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607607.414953:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150090112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607607.414973:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607607.414995:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090240 00000100:00100000:3.0:1789607607.414998:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090240 00010000:00010000:3.0:1789607607.415016:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe78a expref: 19 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607607.415033:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090112 00000100:00100000:3.0:1789607607.415036:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090112 00010000:00010000:3.0:1789607607.415046:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe84e expref: 20 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607607.415072:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607607.415079:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:3471:x1876539150090240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607607.415099:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607607.415104:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe78a expref: 20 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415113:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe78a expref: 20 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415126:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607607.415153:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:3471:x1876539150090240:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607607.415159:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607607.415184:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607607.415191:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3471:x1876539150090112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607607.415198:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607607.415203:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe84e expref: 19 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415212:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe84e expref: 19 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415223:0:16414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415231:0:16414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607607.415244:0:16414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001408673s 00010000:00010000:3.0:1789607607.415248:0:16414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415265:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415271:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415278:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415284:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607607.415288:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415296:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415304:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.415313:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607607.415336:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3471:x1876539150090112:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607607.415342:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607607.415380:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150090112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607607.415388:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150090240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607607.416823:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbe855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe84e expref: 18 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607607.416844:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150089856:0@lo:104: 00010000:00010000:2.0:1789607607.416858:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184800/0xa26202d240fbe791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe78a expref: 17 pid: 16421 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607607.416886:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150089984:0@lo:104: 00010000:00010000:2.0:1789607607.416908:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.416937:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.416944:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607607.416950:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581400/0xa26202d240fbe88d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607607.417901:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607607.419324:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:17063:x1876539150089728:12345-0@lo:253:mount.lustre.0 Request processed in 37172us (37402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.419337:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607607.419477:0:17063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17063:1876539150089728:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607607.419491:0:17063:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789607607.419494:0:17063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607607.419496:0:17063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789607607.419498:0:17063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607607.419499:0:17063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607607.419500:0:17063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607607.419502:0:17063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607607.419503:0:17063:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607607.419504:0:17063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607607.419506:0:17063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607607.419518:0:17063:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607607.426421:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607607.426680:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607607.427445:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607607.427614:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607607.427972:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607607.428315:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607607.434930:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607607.435390:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607607.435803:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607607.436051:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607607.436386:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607607.436782:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:0.0:1789607607.439362:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789607607.439477:0:17087:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789607607.439481:0:17087:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789607607.439646:0:17088:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789607607.439708:0:17088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789607607.441348:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1789607607.445635:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789607607.445751:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607607.445964:0:17088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789607607.446020:0:17088:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789607607.446106:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17089:1876539150090368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.446171:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.446204:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090368 00000100:00100000:1.0:1789607607.446211:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090368 00000100:00100000:1.0:1789607607.446432:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607607.446442:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17089:x1876539150090368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.446510:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17089:x1876539150090368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.446525:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607607.446549:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d941c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789607607.446571:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17089:1876539150090368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789607607.446599:0:17089:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789607607.446626:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17089:1876539150090496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.446653:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.446676:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607607.446902:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090496 00000100:00100000:0.0:1789607607.446907:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090496 00000100:00100000:0.0:1789607607.446934:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607607.446941:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17089:x1876539150090496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789607607.447074:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17089:x1876539150090496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607607.447081:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607607.447120:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17089:1876539150090496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.447185:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17089:1876539150090624:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.447210:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.447237:0:16439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090624 00000100:00100000:1.0:1789607607.447241:0:16439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090624 00000004:00000080:2.0:1789607607.447684:0:17063:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789607607.447693:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1789607607.448215:0:16439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607607.448224:0:16439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17089:x1876539150090624:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789607607.448391:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb13c0 going to sleep for 11 seconds 00000040:00080000:2.0:1789607607.448453:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607607.448610:0:16439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17089:x1876539150090624:12345-0@lo:900:lod0001_rec0000.0 Request processed in 387us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.448618:0:16439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789607607.448649:0:17089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78fd117b80 x1876539150090624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607607.448660:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17089:1876539150090624:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.448707:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17089:1876539150090752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.448731:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607607.448749:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090752 00000100:00100000:1.0:1789607607.448760:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090752 00000100:00100000:1.0:1789607607.448782:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607607.448787:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17089:x1876539150090752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789607607.448831:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17089:x1876539150090752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607607.448837:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607607.448851:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607607.448884:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17089:1876539150090752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789607607.448927:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607607.449803:0:17063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789607607.450566:0:17063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789607607.450601:0:17063:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789607607.450816:0:17063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607607.451830:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789607607.451906:0:17089:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789607607.451911:0:17089:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:2.0:1789607607.453188:0:17063:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/8/4) registered 00000001:00000004:3.0:1789607607.459109:0:17063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789607607.490377:0:17063:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789607607.490407:0:17063:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa81b01d07988 00100000:10000000:0.0:1789607607.490415:0:17063:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789607607.491180:0:17063:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789607607.491220:0:17063:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789607607.491238:0:17063:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789607607.491255:0:17063:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000100:00100000:2.0:1789607607.713980:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607608.226115:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607608.418743:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789607608.618595:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607608.742538:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 10000000:01000000:0.0:1789607609.124390:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789607609.124398:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78d9435000 from 8 10000000:01000000:0.0:1789607609.124404:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789607609.124444:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607609.124457:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607609.124479:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607609.124503:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150090880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607609.124566:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607609.136617:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607609.136648:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150090880 00000100:00100000:0.0:1789607609.136657:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150090880 00000100:00100000:0.0:1789607609.136801:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607609.136809:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:16427:x1876539150090880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607609.136824:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607609.136841:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe894 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607609.136890:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe894 expref: 17 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607609.136901:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe894 expref: 17 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607609.136909:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9600, rc 0) 00000100:00100000:0.0:1789607609.136977:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150090880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (12410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607609.136984:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789607609.141971:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150090880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607609.142000:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607609.142013:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607609.142099:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150091008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607609.142162:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607609.142858:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607609.160340:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091008 00000100:00100000:2.0:1789607609.160354:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091008 00000100:00100000:2.0:1789607609.160421:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607609.160431:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150091008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607609.160457:0:16421:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607609.160476:0:16421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607609.160479:0:16421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789607609.160616:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150091008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (18454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607609.160623:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789607609.160720:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150091008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607609.161203:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607609.161364:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607609.161379:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607609.161389:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607609.161391:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c419c000 from 8 10000000:01000000:1.0:1789607609.161394:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607609.161423:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607609.161431:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607609.161440:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607609.161461:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150091136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607609.161495:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607609.161571:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607609.166128:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091136 00000100:00100000:2.0:1789607609.166142:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091136 00000100:00100000:3.0:1789607609.166270:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607609.166281:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150091136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607609.166299:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607609.166319:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe8a2 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607609.166347:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 18 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607609.166359:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 18 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607609.166368:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607609.166606:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150091136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 326us (5109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607609.166614:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789607609.167031:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150091136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607609.167061:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607609.167071:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607609.167140:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150091264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607609.167194:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607609.167436:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194540 going to sleep for 11 seconds 00000100:00100000:3.0:1789607609.171891:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091264 00000100:00100000:3.0:1789607609.171905:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091264 00000100:00100000:3.0:1789607609.171954:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607609.171963:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150091264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789607609.171984:0:16423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607609.171998:0:16423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607609.172001:0:16423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789607609.172133:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150091264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607609.172145:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607609.172200:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150091264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789607609.172266:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607609.172275:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607609.172285:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607609.252322:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607609.444543:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607609.771262:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789607610.278529:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607610.785978:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:0.0:1789607611.304067:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607611.444778:0:17332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789607611.817353:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 0 seconds 00010000:00010000:1.0:1789607612.329648:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607612.643253:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789607612.643259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1789607612.643262:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00080000:3.0:1789607612.643263:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607612.643278:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78e0e9a000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607612.643279:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150091520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607612.643297:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0703b80 x1876539150091648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607612.643312:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607612.643315:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607612.643317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607612.643320:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607612.643338:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789607612.643339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607612.643342:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607612.643344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607612.643357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607612.643383:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150091648:0@lo:38:kworker.0 00000100:00100000:0.0:1789607612.643384:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150091392:0@lo:400:kworker.0 00000100:00100000:0.0:1789607612.643409:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607612.643668:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150091904:0@lo:400:kworker.0 00000100:00100000:1.0:1789607612.644082:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607612.644095:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150091776:0@lo:400:kworker.0 00000100:00100000:3.0:1789607612.651235:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607612.651360:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150092032:0@lo:400:kworker.0 00000100:00100000:3.0:1789607612.651422:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607612.651469:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091392 00000100:00100000:3.0:1789607612.651477:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091392 00000100:00100000:3.0:1789607612.651532:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607612.651541:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:3469:x1876539150091392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607612.651595:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:3469:x1876539150091392:12345-0@lo:400:kworker.0 Request processed in 54us (8184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607612.651602:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607612.651967:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092032 00000100:00100000:3.0:1789607612.651973:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092032 00000100:00100000:3.0:1789607612.652127:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607612.652135:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150092032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607612.652178:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150092032:12345-0@lo:400:kworker.0 Request processed in 45us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607612.652185:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789607612.652237:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78f0700700 x1876539150092032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607612.652251:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150092032:0@lo:400:kworker.0 00000100:00100000:0.0:1789607612.653347:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150091392:0@lo:400:kworker.0 00000100:00100000:0.0:1789607612.657262:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091520 00000100:00100000:0.0:1789607612.657275:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091520 00000100:00100000:0.0:1789607612.657323:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091648 00000100:00100000:0.0:1789607612.657327:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091648 00000100:00100000:0.0:1789607612.657342:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607612.657352:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150091520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607612.657394:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607612.657476:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150091520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (14137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.657484:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607612.657500:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607612.657505:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150091648:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789607612.657528:0:16434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:0.0:1789607612.657566:0:16434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbe8b0 00000004:00100000:0.0:1789607612.657581:0:16434:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789607612.657586:0:16434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789607612.659239:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150091520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607612.663536:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607612.663672:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091904 00000100:00100000:0.0:1789607612.663687:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091904 00000100:00100000:0.0:1789607612.663753:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607612.663764:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607612.663823:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150091904:12345-0@lo:400:kworker.0 Request processed in 62us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.663830:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607612.663844:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150091904:0@lo:400:kworker.0 00000100:00100000:1.0:1789607612.669679:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607612.669728:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150091776 00000100:00100000:1.0:1789607612.669737:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150091776 00000100:00100000:1.0:1789607612.669856:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607612.669880:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150091776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607612.669935:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150091776:12345-0@lo:400:kworker.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607612.669941:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789607612.669983:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78f0700000 x1876539150091776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607612.669996:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150091776:0@lo:400:kworker.0 00000100:00080000:0.0:1789607612.726830:0:16434:0:(import.c:65:import_set_state_nolock()) ffff8d78f5860800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607612.727428:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539150091648:12345-0@lo:38:kworker.0 Request processed in 69917us (76195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.727439:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789607612.727509:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789607612.727518:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789607612.727524:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789607612.727527:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789607612.727549:0:3467:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d911c92c): req@ffff8d78fd114e00 x1876539150084608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607612.727566:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150091648:0@lo:38:kworker.0 00000100:00100000:0.0:1789607612.727628:0:16471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607612.727651:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607612.727664:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150084608 00000100:00100000:0.0:1789607612.727671:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150084608 00000100:00100000:0.0:1789607612.727700:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607612.727707:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:16471:x1876539150084608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789607612.728802:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150092160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607612.728856:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607612.729488:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:16471:x1876539150084608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1776us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.729498:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607612.729518:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092160 00000100:00100000:0.0:1789607612.729533:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092160 00000100:00100000:0.0:1789607612.729563:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607612.729572:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150092160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607612.729605:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607612.729645:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150092160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.729651:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607612.729713:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150092160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607612.736341:0:16471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16471:1876539150084608:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789607612.736395:0:16471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789607612.736444:0:16471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16471:1876539150092288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789607612.736509:0:16471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607612.736548:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607612.736588:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092288 00000100:00100000:0.0:1789607612.736596:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092288 00000100:00100000:0.0:1789607612.736637:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607612.736647:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:16471:x1876539150092288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789607612.737938:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:16471:x1876539150092288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1291us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.737949:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607612.738115:0:16471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16471:1876539150092288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789607612.738858:0:16471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16471:1876539150092416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789607612.738931:0:16471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607612.739035:0:16471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607612.739769:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092416 00000100:00100000:0.0:1789607612.739778:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092416 00000100:00100000:0.0:1789607612.739825:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607612.739836:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16471:x1876539150092416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789607612.739977:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16471:x1876539150092416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 143us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607612.739985:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607612.740036:0:16471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16471:1876539150092416:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789607612.740090:0:16471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607612.743670:0:16471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789607612.743741:0:16471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 16, retries 0 00000004:00080000:0.0:1789607612.743752:0:16471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789607613.346155:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789607614.225769:0:17484:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5971a680 20000000:00000080:0.0:1789607614.225788:0:17484:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d78c5058400 uarg=0000000000000000 20000000:01000000:0.0:1789607614.225824:0:17484:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789607614.225831:0:17484:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789607614.225837:0:17484:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789607614.233283:0:17485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789607614.233491:0:17484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789607614.240708:0:17484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789607614.240795:0:17484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.240815:0:17484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe759 expref: 17 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.240822:0:17484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe85c expref: 17 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.240828:0:17484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.240897:0:17484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe85c expref: 17 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.240913:0:17484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe85c expref: 17 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607614.240928:0:17484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17484:1876539150092544:0@lo:104: 00000100:00100000:0.0:1789607614.241017:0:17484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607614.241072:0:17484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe759 expref: 17 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.241098:0:17484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe759 expref: 17 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607614.241107:0:17484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17484:1876539150092672:0@lo:104: 00000100:00100000:0.0:1789607614.241128:0:17484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607614.241144:0:17484:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607614.241321:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092544 00000100:00100000:1.0:1789607614.241329:0:16413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092544 00000100:00100000:1.0:1789607614.241367:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092672 00000100:00100000:1.0:1789607614.241370:0:16413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092672 00000100:00100000:1.0:1789607614.241386:0:16413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607614.241394:0:16413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:17484:x1876539150092544:12345-0@lo:104: 00010000:00010000:1.0:1789607614.241407:0:16413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241457:0:16413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607614.241462:0:16413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:17484:x1876539150092544:12345-0@lo:104: Request processed in 69us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607614.241469:0:16413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607614.241485:0:16413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607614.241490:0:16413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:17484:x1876539150092672:12345-0@lo:104: 00010000:00010000:1.0:1789607614.241497:0:16413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241536:0:16413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607614.241541:0:16413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:17484:x1876539150092672:12345-0@lo:104: Request processed in 51us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607614.241547:0:16413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789607614.241560:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607614.241565:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241573:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607614.241583:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241592:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607614.241599:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607614.241605:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607614.241630:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241636:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607614.241654:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241661:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe85c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe863 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241673:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607614.241677:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241683:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607614.241686:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241693:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607614.241709:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607614.241714:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607614.241726:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241731:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607614.241746:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241753:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd580600/0xa26202d240fbe759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe760 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.241765:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607614.241767:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607614.241768:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607614.241773:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607614.241790:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150092800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607614.241822:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607614.241856:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150092928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607614.241902:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607614.241947:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092800 00000100:00100000:1.0:1789607614.241951:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092800 00010000:00010000:1.0:1789607614.242090:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe85c expref: 18 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607614.242110:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150092928 00000100:00100000:1.0:1789607614.242118:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150092928 00010000:00010000:1.0:1789607614.242129:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe759 expref: 19 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607614.242140:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607614.242145:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3469:x1876539150092800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607614.242154:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607614.242159:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe85c expref: 19 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242168:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe85c expref: 19 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242182:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607614.242207:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3469:x1876539150092800:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607614.242213:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607614.242225:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607614.242230:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:3470:x1876539150092928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607614.242237:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607614.242241:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe759 expref: 18 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242249:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe759 expref: 18 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242260:0:16415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242267:0:16415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242284:0:16415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242291:0:16415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242297:0:16415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242304:0:16415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242309:0:16415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607614.242313:0:16415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242319:0:16415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242327:0:16415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.242336:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607614.242363:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:3470:x1876539150092928:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607614.242370:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607614.242410:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150092928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607614.242433:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150092800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607614.242836:0:17484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580e00/0xa26202d240fbe863 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe85c expref: 17 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607614.242848:0:17484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17484:1876539150092544:0@lo:104: 00010000:00010000:0.0:1789607614.242882:0:17484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581e00/0xa26202d240fbe760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe759 expref: 16 pid: 16423 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607614.242891:0:17484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17484:1876539150092672:0@lo:104: 00010000:00010000:0.0:1789607614.242911:0:17484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.242919:0:17484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.242925:0:17484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607614.242932:0:17484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbe8b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607614.372522:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607615.394782:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607615.586374:0:16427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607615.586383:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78d9435000 from 13 10000000:01000000:1.0:1789607615.586388:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607615.586431:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.586443:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.586454:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607615.586476:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.586534:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607615.586571:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607615.586615:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093056 00000100:00100000:3.0:1789607615.586623:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093056 00000100:00100000:3.0:1789607615.586673:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607615.586681:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+16:16427:x1876539150093056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607615.586696:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607615.586709:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe8be expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607615.586731:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe8be expref: 17 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607615.586740:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8be expref: 17 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607615.586749:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e000, rc 0) 00000100:00100000:3.0:1789607615.586790:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150093056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607615.586797:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789607615.586928:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607615.586942:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.586952:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607615.587031:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.587055:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607615.587070:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607615.587339:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093184 00000100:00100000:3.0:1789607615.587344:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093184 00000100:00100000:3.0:1789607615.587417:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607615.587424:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150093184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607615.587667:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150093184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607615.587673:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607615.587733:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.587764:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.587812:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607615.589776:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607615.591075:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093312 00000100:00100000:0.0:1789607615.591089:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093312 00000100:00100000:0.0:1789607615.591793:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607615.591817:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150093312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607615.592078:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150093312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (4264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607615.592086:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607615.592312:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789607615.593143:0:17532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789607615.593347:0:16427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789607615.593373:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607615.593384:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.593395:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607615.593407:0:16427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607615.593410:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c419c000 from 13 10000000:01000000:1.0:1789607615.593412:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607615.593447:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.593455:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.593465:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607615.593488:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.593543:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607615.593570:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607615.593772:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093440 00000100:00100000:0.0:1789607615.593778:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093440 00000100:00100000:0.0:1789607615.593808:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607615.593818:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+17:16427:x1876539150093440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607615.593830:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607615.593844:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe8cc expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607615.593889:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607615.593901:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 18 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607615.593908:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8600, rc 0) 00000100:00100000:0.0:1789607615.593950:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150093440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607615.593957:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607615.594365:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607615.594380:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607615.594398:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607615.594444:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.594469:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607615.594490:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607615.594501:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093568 00000100:00100000:1.0:1789607615.594504:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093568 00000100:00100000:1.0:1789607615.594521:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789607615.594526:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150093568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.594743:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150093568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607615.594750:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789607615.594872:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.594898:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.594930:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607615.594942:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607615.594952:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093696 00000100:00100000:1.0:1789607615.594954:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093696 00000100:00100000:1.0:1789607615.594969:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607615.598248:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150093696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607615.598477:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:16427:x1876539150093696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607615.598486:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607615.598565:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150093696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789607615.602271:0:17534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789607615.602626:0:16427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789607615.602646:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607615.602656:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607615.602669:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607616.418393:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607617.447852:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607617.762092:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150093824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607617.762162:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607617.762228:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093824 00000100:00100000:0.0:1789607617.762236:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093824 00000100:00100000:0.0:1789607617.762287:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607617.762295:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607607/real 1789607607] req@ffff8d78fd4e8a80 x1876539150087680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607617.762297:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150093824:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607617.762331:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fd4e8a80 x1876539150087680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1789607617.762336:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607617.762343:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607607/real 1789607607] req@ffff8d78fd4eb480 x1876539150087552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607617.762358:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fd4eb480 x1876539150087552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789607617.762372:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607617.762382:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789607617.762383:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150093824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607617.762389:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150087680:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789607617.762394:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789607617.762398:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607617.762406:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607617.762409:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150087552:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789607617.762458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607617.762461:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607617.762465:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607617.762468:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607617.762491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607617.762494:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789607617.762496:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607617.762501:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789607617.762506:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607617.762515:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d78fcb5f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607617.762534:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd82300 x1876539150094336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607617.762550:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607617.762566:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607617.762568:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607617.762572:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789607617.762575:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607617.762581:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78e0099000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607617.762595:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd83800 x1876539150094464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607617.762625:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150093952:0@lo:400:kworker.0 00000100:00100000:0.0:1789607617.762657:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607617.762690:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607617.762695:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150094080:0@lo:400:kworker.0 00000100:00100000:0.0:1789607617.762719:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607617.762747:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150093952 00000100:00100000:0.0:1789607617.762751:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150093952 00000100:00100000:0.0:1789607617.762773:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789607617.762779:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:3468:x1876539150093952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607617.762809:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:3468:x1876539150093952:12345-0@lo:400:kworker.0 Request processed in 31us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607617.762815:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789607617.762839:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150094208:0@lo:400:kworker.0 00000100:00100000:3.0:1789607617.762852:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150094080 00000100:00100000:3.0:1789607617.762881:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150094080 00000100:00100000:0.0:1789607617.762886:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607617.762908:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607617.762913:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150094592:0@lo:400:kworker.0 00000100:00100000:0.0:1789607617.762937:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607617.762958:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150094208 00000100:00100000:0.0:1789607617.762966:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150094208 00000100:00100000:0.0:1789607617.763000:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607617.763005:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150094208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607617.763040:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150094208:12345-0@lo:400:kworker.0 Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607617.763045:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607617.763064:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150094592 00000100:00100000:0.0:1789607617.763068:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150094592 00000100:00100000:3.0:1789607617.763617:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607617.763746:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150094080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607617.763798:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150094080:12345-0@lo:400:kworker.0 Request processed in 172us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607617.765020:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150094720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607617.765074:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789607617.765785:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78fcd83480 x1876539150094080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607617.765802:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150094080:0@lo:400:kworker.0 00000100:00100000:1.0:1789607617.765821:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150093952:0@lo:400:kworker.0 00000100:00100000:1.0:1789607617.765888:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150094720 00000100:00100000:1.0:1789607617.765895:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150094720 00000100:00100000:0.0:1789607617.765902:0:16429:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607617.765912:0:16429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789607617.766013:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607617.766023:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150094720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607617.766062:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607617.766363:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607617.766498:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607617.767242:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150094336:0@lo:8:kworker.0 00000100:00100000:1.0:1789607617.767283:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150094720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1259us (2206us total) trans 0 rc 0/0 00000400:00000100:2.0:1789607617.767288:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150094336 offset 0 length 520: 4 00000100:00100000:1.0:1789607617.767296:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607617.767328:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150094464:0@lo:8:kworker.0 00000100:00100000:1.0:1789607617.767358:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150093824:0@lo:41:osp-pre-1-0.0 00000400:00000100:2.0:1789607617.767364:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150094464 offset 0 length 520: 4 00000100:00100000:2.0:1789607617.767400:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607617.767412:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150094720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607617.767450:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150094592:12345-0@lo:400:kworker.0 Request processed in 1078us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607617.767459:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789607617.767529:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78fcd82d80 x1876539150094592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607617.767540:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150094592:0@lo:400:kworker.0 00000100:00100000:2.0:1789607617.767554:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150094208:0@lo:400:kworker.0 00000001:00100000:3.0:1789607617.836917:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789607618.467770:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607618.868451:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789607619.491422:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607619.509110:0:17736:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607619.509114:0:17736:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789607619.509244:0:17736:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d78c78e0000 00000020:01000004:2.0:1789607619.509261:0:17736:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789607619.509275:0:17736:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607619.509289:0:17736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d78c5b90000) 00000020:00000080:2.0:1789607619.509307:0:17736:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789607619.525289:0:17736:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789607619.525728:0:17736:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789607619.526757:0:17736:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789607619.527327:0:17736:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789607619.527569:0:17736:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789607619.529574:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 653: rc = 0 00100000:10000000:1.0:1789607619.529673:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 653: rc = 0 00100000:10000000:1.0:1789607619.530026:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 653: rc = 0 00100000:10000000:1.0:1789607619.530579:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 441: rc = 0 00100000:10000000:1.0:1789607619.531039:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 441: rc = 0 00100000:10000000:1.0:1789607619.531389:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 441: rc = 0 00100000:10000000:1.0:1789607619.531618:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 441: rc = 0 00100000:10000000:1.0:1789607619.532216:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 441: rc = 0 00100000:10000000:1.0:1789607619.532462:0:17736:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 441: rc = 0 00000020:00000080:1.0:1789607619.533173:0:17736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789607619.533186:0:17736:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789607619.533200:0:17736:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa26202d240fbe8e1 00000020:01000004:1.0:1789607619.533208:0:17736:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789607619.533229:0:17736:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789607619.533232:0:17736:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789607619.533239:0:17736:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789607619.533244:0:17736:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789607619.533284:0:17736:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d77c4194d40) 00000020:00000080:1.0:1789607619.533299:0:17736:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789607619.536277:0:17736:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607619.536533:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789607619.536540:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789607619.543934:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789607619.543955:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789607619.544432:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789607619.544440:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789607619.547553:0:17736:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607619.547720:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789607619.547726:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789607619.548340:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789607619.548348:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789607619.579170:0:17736:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607619.579520:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789607619.579526:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789607619.582128:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789607619.582145:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789607619.583979:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789607619.583998:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789607619.587799:0:17736:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607619.588297:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789607619.588304:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789607619.590137:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789607619.590149:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789607619.644197:0:17736:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607619.644396:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789607619.644403:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789607619.653266:0:17736:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789607619.653287:0:17736:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789607619.654556:0:17736:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789607619.654637:0:17736:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789607619.654643:0:17736:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789607619.669539:0:17736:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789607619.669578:0:17736:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789607619.669582:0:17736:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789607619.669584:0:17736:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607619.669586:0:17736:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607619.669587:0:17736:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607619.669588:0:17736:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607619.669590:0:17736:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607619.669591:0:17736:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607619.669593:0:17736:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607619.669594:0:17736:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607619.669598:0:17736:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789607619.669600:0:17736:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607619.669601:0:17736:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607619.669602:0:17736:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607619.669603:0:17736:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607619.669604:0:17736:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607619.669605:0:17736:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607619.669606:0:17736:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607619.669607:0:17736:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607619.669608:0:17736:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607619.669636:0:17736:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789607619.669655:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150094848:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607619.669732:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.669835:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.670202:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150094848 00000100:00100000:2.0:1789607619.670216:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150094848 00000100:00100000:3.0:1789607619.670377:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789607619.670386:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17736:x1876539150094848:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789607619.670414:0:16424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789607619.670418:0:16424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789607619.670421:0:16424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000040:00080000:2.0:1789607619.684448:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607619.709663:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17736:x1876539150094848:12345-0@lo:253:mount.lustre.0 Request processed in 39270us (39923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.709677:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789607619.709778:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150094848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789607619.709806:0:17736:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789607619.709816:0:17736:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607619.709818:0:17736:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789607619.709819:0:17736:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607619.709820:0:17736:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607619.709821:0:17736:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607619.709822:0:17736:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607619.709823:0:17736:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607619.709825:0:17736:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607619.709826:0:17736:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607619.709848:0:17736:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d78c78e0000 from lustre-OST0000 10000000:01000000:0.0:1789607619.709892:0:17736:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789607619.709895:0:17736:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789607619.709903:0:17736:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78fd3f3380 local copy 00010000:00010000:0.0:1789607619.709914:0:17736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607619.710184:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150094976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607619.710233:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.710267:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.710803:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150094976 00000100:00100000:2.0:1789607619.710812:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150094976 00000100:00100000:2.0:1789607619.710858:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607619.710888:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17736:x1876539150094976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607619.711113:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17736:x1876539150094976:12345-0@lo:501:mount.lustre.0 Request processed in 226us (878us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607619.711120:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789607619.711263:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150094976:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789607619.711280:0:17736:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789607619.711438:0:17736:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789607619.711447:0:17736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.711458:0:17736:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607619.711481:0:17736:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78c78e0000 10000000:01000000:0.0:1789607619.711486:0:17736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789607619.711490:0:17736:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789607619.711493:0:17736:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607619.711497:0:17736:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789607619.711499:0:17736:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607619.711526:0:17736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.711535:0:17736:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.711697:0:17736:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607619.711728:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607619.712026:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.712126:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9ead80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607619.716206:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095104 00000100:00100000:3.0:1789607619.716243:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095104 00000100:00100000:3.0:1789607619.716296:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789607619.716306:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f618b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+18:17736:x1876539150095104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607619.716322:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607619.716341:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571ea00/0xa26202d240fbe8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe8ef expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.716370:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571ea00/0xa26202d240fbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe8ef expref: 19 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.716382:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571ea00/0xa26202d240fbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8ef expref: 19 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.716391:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ea00, rc 0) 00000100:00100000:3.0:1789607619.716474:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f618b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095104:12345-0@lo:101:mount.lustre.0 Request processed in 169us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.716481:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789607619.716678:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607619.716697:0:17736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.716708:0:17736:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607619.717445:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789607619.718280:0:17736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607619.718498:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789607619.718541:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789607619.718577:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789607619.718639:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789607619.718684:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789607619.718711:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789607619.718762:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789607619.718769:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789607619.718841:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607619.718918:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.718954:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e29410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.719061:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095232 00000100:00100000:2.0:1789607619.719067:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095232 00000100:00100000:3.0:1789607619.719413:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789607619.719426:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607619.720138:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095232:12345-0@lo:501:mount.lustre.0 Request processed in 713us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.720148:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607619.720253:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607619.720298:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607619.720345:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.720374:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.720401:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095360 00000100:00100000:2.0:1789607619.720409:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095360 00000100:00100000:2.0:1789607619.720445:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607619.720453:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607619.720754:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095360:12345-0@lo:503:mount.lustre.0 Request processed in 301us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607619.720761:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789607619.721120:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607619.721661:0:17736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607619.721730:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.721780:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.721827:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fa9ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607619.722189:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095488 00000100:00100000:3.0:1789607619.722195:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095488 00000100:00100000:3.0:1789607619.722248:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789607619.722256:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607619.722548:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095488:12345-0@lo:502:mount.lustre.0 Request processed in 292us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607619.722555:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607619.722605:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607619.722844:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789607619.722924:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789607619.722981:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789607619.723043:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789607619.723080:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789607619.723115:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789607619.723161:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789607619.723402:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789607619.723449:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789607619.723517:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789607619.723571:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789607619.723619:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789607619.723658:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607619.723716:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.723756:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607619.724322:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095616 00000100:00100000:0.0:1789607619.724331:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095616 00000100:00100000:0.0:1789607619.724450:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607619.724460:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.724675:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095616:12345-0@lo:502:mount.lustre.0 Request processed in 216us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.724682:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789607619.724998:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607619.725092:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789607619.725105:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789607619.726457:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607619.726465:0:17750:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789607619.726471:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.726473:0:17750:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789607619.726477:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607619.726490:0:17750:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d78f9d2cd40) 00000020:00000080:3.0:1789607619.726513:0:17750:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789607619.726518:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789607619.726574:0:17750:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78c78e0000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789607619.726581:0:17750:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607619.726586:0:17750:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa26202d240fbe904 00010000:00010000:1.0:1789607619.732419:0:17750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789607619.733781:0:17750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789607619.735786:0:17750:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789607619.747476:0:17750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789607619.747488:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.747494:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.747496:0:17750:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789607619.747499:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789607619.747502:0:17750:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789607619.747503:0:17750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607619.747505:0:17750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607619.747506:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789607619.747508:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.747509:0:17750:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789607619.747524:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607619.747542:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.747544:0:17750:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789607619.747548:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789607619.747550:0:17750:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789607619.747552:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.747555:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.747556:0:17750:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789607619.747558:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607619.747560:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.747561:0:17750:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789607619.747564:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789607619.747624:0:17750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.747628:0:17750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.747629:0:17750:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789607619.747632:0:17750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789607619.748104:0:17736:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789607619.748137:0:17736:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789607619.748158:0:17736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.748170:0:17736:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607619.748178:0:17736:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c78e0000 from 1 10000000:01000000:1.0:1789607619.748181:0:17736:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607619.748225:0:17736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.748233:0:17736:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.748243:0:17736:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607619.748264:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607619.748329:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.748369:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095744 00000100:00100000:1.0:1789607619.748371:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607619.748377:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095744 00000100:00100000:0.0:1789607619.748421:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789607619.748431:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150095744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607619.748443:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607619.748463:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe90b expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.748506:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe90b expref: 20 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.748517:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe90b expref: 20 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.748525:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9c00, rc 0) 00000100:00100000:0.0:1789607619.748571:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150095744:12345-0@lo:101:mount.lustre.0 Request processed in 141us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.748577:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607619.748709:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607619.748723:0:17736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.748730:0:17736:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607619.749603:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789607619.750679:0:17736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607619.751784:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789607619.754599:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789607619.754717:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789607619.754726:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789607619.755579:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607619.755645:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.755684:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607619.757085:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150095872 00000100:00100000:3.0:1789607619.757098:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150095872 00000100:00100000:3.0:1789607619.757146:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607619.757156:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150095872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607619.757455:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150095872:12345-0@lo:501:mount.lustre.0 Request processed in 300us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.757463:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789607619.757831:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150095872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607619.757906:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607619.757962:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607619.758001:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607619.758386:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096000 00000100:00100000:1.0:1789607619.758393:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096000 00000100:00100000:1.0:1789607619.758432:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607619.758441:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607619.758611:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096000:12345-0@lo:503:mount.lustre.0 Request processed in 171us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607619.758619:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789607619.758712:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607619.765404:0:17736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607619.765500:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.765587:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.766349:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.767749:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096128 00000100:00100000:2.0:1789607619.767761:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096128 00000100:00100000:2.0:1789607619.767826:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789607619.767837:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607619.768191:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096128:12345-0@lo:502:mount.lustre.0 Request processed in 357us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607619.768199:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789607619.768447:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607619.768788:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789607619.768840:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789607619.769152:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789607619.769211:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789607619.769247:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789607619.769299:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789607619.769339:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789607619.769373:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789607619.769422:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789607619.769459:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789607619.769492:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789607619.769533:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.769596:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.769738:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096256 00000100:00100000:1.0:1789607619.769745:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096256 00000100:00100000:1.0:1789607619.769831:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789607619.769842:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607619.772010:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096256:12345-0@lo:502:mount.lustre.0 Request processed in 2164us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607619.772024:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789607619.772294:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607619.772323:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607619.772482:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789607619.772497:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789607619.774502:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607619.774513:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.774515:0:17754:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789607619.774521:0:17754:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78c78e0000 00000020:00000080:3.0:1789607619.774524:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607619.774531:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.774533:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.774535:0:17754:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789607619.774537:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607619.774539:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.774559:0:17754:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789607619.774565:0:17754:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78c78e0000 00000020:00000080:3.0:1789607619.774567:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607619.774717:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.774721:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.774723:0:17754:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789607619.774725:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607619.774728:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.774730:0:17754:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789607619.774733:0:17754:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78c78e0000 00000020:00000080:3.0:1789607619.774735:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607619.776225:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.776235:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.776237:0:17754:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789607619.776240:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607619.776243:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.776244:0:17754:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789607619.776248:0:17754:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78c78e0000 00000020:00000080:3.0:1789607619.776251:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607619.776321:0:17754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607619.776325:0:17754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607619.776327:0:17754:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789607619.776330:0:17754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789607619.776457:0:17736:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789607619.776482:0:17736:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607619.776505:0:17736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.776525:0:17736:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607619.776569:0:17736:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789607619.776572:0:17736:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78c78e0000 10000000:01000000:1.0:1789607619.776576:0:17736:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78c78e0000 10000000:01000000:1.0:1789607619.776579:0:17736:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607619.776584:0:17736:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c78e0000 from 1 10000000:01000000:1.0:1789607619.776587:0:17736:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789607619.776620:0:17736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.776628:0:17736:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.776639:0:17736:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607619.776662:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607619.776724:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.776775:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.776851:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096384 00000100:00100000:2.0:1789607619.776858:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096384 00000100:00100000:2.0:1789607619.776925:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789607619.776934:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:17736:x1876539150096384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607619.776947:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607619.776960:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd581000/0xa26202d240fbe920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe919 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607619.776992:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581000/0xa26202d240fbe920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe919 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607619.777001:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd581000/0xa26202d240fbe920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe919 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607619.777009:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581000, rc 0) 00000100:00100000:2.0:1789607619.777054:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096384:12345-0@lo:101:mount.lustre.0 Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607619.777080:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607619.777094:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607619.777107:0:17736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607619.777116:0:17736:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607619.777648:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789607619.777978:0:17736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607619.778214:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789607619.778257:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789607619.778290:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789607619.778346:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789607619.778384:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789607619.778430:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789607619.778464:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789607619.778498:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789607619.778544:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789607619.778581:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789607619.778619:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789607619.778685:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789607619.778722:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789607619.778753:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789607619.778796:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789607619.778824:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789607619.778853:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789607619.778928:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789607619.778976:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789607619.779013:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789607619.779059:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789607619.779094:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789607619.779127:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789607619.779176:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789607619.779213:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789607619.779246:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789607619.779292:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789607619.779341:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789607619.779374:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789607619.779427:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789607619.779461:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789607619.779491:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789607619.779539:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789607619.779586:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789607619.779620:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789607619.779665:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789607619.779697:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789607619.779772:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789607619.779779:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789607619.779891:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607619.779949:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.781173:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096512 00000100:00100000:3.0:1789607619.781184:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096512 00000100:00100000:3.0:1789607619.781230:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607619.781240:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607619.781514:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096512:12345-0@lo:501:mount.lustre.0 Request processed in 274us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.781522:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789607619.784463:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607619.784498:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607619.784556:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607619.784617:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.786700:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607619.793195:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096640 00000100:00100000:3.0:1789607619.793209:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096640 00000100:00100000:3.0:1789607619.793263:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607619.793273:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607619.793576:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096640:12345-0@lo:503:mount.lustre.0 Request processed in 305us (8959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.793584:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789607619.794187:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789607619.794694:0:17736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607619.794779:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607619.794832:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.794894:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607619.795744:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096768 00000100:00100000:2.0:1789607619.795752:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096768 00000100:00100000:2.0:1789607619.795798:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789607619.795805:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607619.800006:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096768:12345-0@lo:502:mount.lustre.0 Request processed in 4192us (5164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607619.800021:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789607619.801034:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607619.801493:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789607619.801546:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789607619.801573:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789607619.801609:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789607619.801637:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789607619.801675:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789607619.801702:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789607619.801742:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789607619.801781:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789607619.801808:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789607619.801835:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789607619.801913:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789607619.801948:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789607619.801986:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789607619.802026:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789607619.802054:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789607619.802093:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789607619.802130:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789607619.802158:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789607619.802183:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789607619.802219:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789607619.802246:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789607619.802271:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789607619.802322:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789607619.802362:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789607619.802393:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789607619.802433:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789607619.802461:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789607619.802487:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789607619.802535:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789607619.802566:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789607619.802592:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789607619.802617:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789607619.802653:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789607619.802680:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789607619.802716:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789607619.802743:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789607619.802772:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789607619.802811:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789607619.802852:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789607619.802906:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789607619.802934:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789607619.808165:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789607619.808285:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789607619.808336:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789607619.808449:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789607619.808498:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789607619.808533:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789607619.808619:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.808701:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.808745:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194300 going to sleep for 11 seconds 00000100:00100000:0.0:1789607619.808777:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150096896 00000100:00100000:0.0:1789607619.808784:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150096896 00000100:00100000:0.0:1789607619.811314:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789607619.811333:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.811619:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150096896:12345-0@lo:502:mount.lustre.0 Request processed in 293us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.811627:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789607619.817630:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150096896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607619.817812:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789607619.818351:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789607619.818397:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150097024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607619.818467:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607619.818515:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607619.818622:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097024 00000100:00100000:1.0:1789607619.818629:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097024 00000100:00100000:1.0:1789607619.818677:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789607619.818685:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150097024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607619.818915:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150097024:12345-0@lo:502:mount.lustre.0 Request processed in 230us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607619.818929:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789607619.819318:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150097024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607619.819449:0:17736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789607619.819461:0:17736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789607619.822459:0:17759:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789607619.822476:0:17759:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d78e9ee99c0) 00000020:00000080:0.0:1789607619.822499:0:17759:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789607619.822592:0:17759:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78c78e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789607619.822597:0:17759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78c78e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789607619.822599:0:17759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c78e0000 3 00010000:00080000:0.0:1789607619.822636:0:17759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c10f0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607619.827626:0:17759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789607619.830830:0:17759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789607619.830896:0:17759:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789607619.830907:0:17759:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa26202d240fbe92e 00000100:00080000:1.0:1789607619.830921:0:17759:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607619.830933:0:17759:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d77c10f0000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607619.831057:0:17759:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd116d80 x1876539150097152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607619.831148:0:17759:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607619.831222:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150097152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607619.831288:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789607619.831368:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.831373:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607619.831376:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.831378:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607619.831403:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.831406:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607619.831408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.831411:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607619.831440:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097152 00000100:00100000:3.0:1789607619.831446:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097152 00000100:00100000:3.0:1789607619.831485:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607619.831493:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150097152:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789607619.831515:0:16430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1789607619.831564:0:16430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa26202d240fbe935 00000004:00100000:3.0:1789607619.831577:0:16430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607619.831606:0:16430:0:(import.c:65:import_set_state_nolock()) ffff8d78c635d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607619.831661:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3467:x1876539150097152:12345-0@lo:38:llog_process_th.0 Request processed in 167us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.831667:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607619.831693:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150097280:0@lo:400:kworker.0 00000100:00100000:3.0:1789607619.831720:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.831740:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607619.831745:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150097664:0@lo:400:kworker.0 00000100:00100000:3.0:1789607619.831764:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.831793:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150097408:0@lo:400:kworker.0 00000100:00100000:3.0:1789607619.831814:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789607619.834241:0:17759:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789607619.834260:0:17759:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d77c41919c0) 00000020:00000080:1.0:1789607619.834283:0:17759:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789607619.834349:0:17759:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78c78e0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789607619.834353:0:17759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78c78e0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789607619.834356:0:17759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c78e0000 3 00010000:00080000:1.0:1789607619.834383:0:17759:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c10aa800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607619.838446:0:17759:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789607619.838624:0:17759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789607619.838664:0:17759:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789607619.838677:0:17759:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa26202d240fbe943 00000100:00080000:1.0:1789607619.838686:0:17759:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607619.838698:0:17759:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d77c10aa800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607619.838732:0:17759:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78e9d08a80 x1876539150097792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607619.838749:0:17759:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789607619.839200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.839204:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607619.839207:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.839209:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607619.839212:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.839215:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607619.839218:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607619.839221:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607619.839251:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150097536:0@lo:400:kworker.0 00000100:00100000:3.0:1789607619.839309:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607619.839554:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097280 00000100:00100000:1.0:1789607619.839565:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097280 00000100:00100000:1.0:1789607619.839602:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097536 00000100:00100000:1.0:1789607619.839604:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097536 00000100:00100000:1.0:1789607619.839618:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607619.839626:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150097280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607619.839680:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150097280:12345-0@lo:400:kworker.0 Request processed in 55us (7959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607619.839686:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607619.839699:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607619.839705:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150097536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607619.839731:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150097536:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607619.839735:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607619.843220:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097664 00000100:00100000:0.0:1789607619.843234:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097664 00000100:00100000:0.0:1789607619.843290:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097408 00000100:00100000:0.0:1789607619.843294:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097408 00000100:00100000:0.0:1789607619.843314:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607619.843322:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150097664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607619.843402:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150097664:12345-0@lo:400:kworker.0 Request processed in 81us (11636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.843420:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607619.843436:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607619.843442:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150097408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607619.843471:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150097408:12345-0@lo:400:kworker.0 Request processed in 31us (11657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.843477:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607619.843666:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150097536:0@lo:400:kworker.0 00010000:00080000:3.0:1789607619.843705:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78f0701180 x1876539150097664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607619.843729:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150097664:0@lo:400:kworker.0 00000100:00100000:3.0:1789607619.843744:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150097280:0@lo:400:kworker.0 00000100:00100000:3.0:1789607619.843774:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150097792:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607619.843813:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789607619.843892:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78fd116d80 x1876539150097152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607619.843900:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607619.843909:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789607619.843916:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789607619.843921:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607619.843924:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607619.843930:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150097152:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789607619.843980:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78f0703100 x1876539150097408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607619.843989:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150097408:0@lo:400:kworker.0 00000100:00100000:0.0:1789607619.844368:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097792 00000100:00100000:0.0:1789607619.844373:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097792 00000100:00100000:0.0:1789607619.844396:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607619.844402:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150097792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607619.844428:0:16430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:0.0:1789607619.844464:0:16430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa26202d240fbe94a 00000004:00100000:0.0:1789607619.844476:0:16430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607619.844504:0:16430:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607619.844548:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3467:x1876539150097792:12345-0@lo:38:llog_process_th.0 Request processed in 145us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.844554:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789607619.844583:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78e9d08a80 x1876539150097792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607619.844591:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607619.844595:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789607619.844601:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789607619.844604:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789607619.844606:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c10aa800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789607619.844610:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150097792:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789607619.850598:0:17759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789607619.850972:0:17736:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789607619.850996:0:17736:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607619.851047:0:17736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607619.851310:0:17736:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789607619.851365:0:17736:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789607619.851368:0:17736:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607619.851369:0:17736:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607619.851370:0:17736:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607619.851371:0:17736:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607619.851373:0:17736:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607619.851374:0:17736:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607619.851376:0:17736:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607619.851377:0:17736:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607619.851381:0:17736:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789607619.851383:0:17736:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607619.851385:0:17736:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607619.851386:0:17736:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607619.851387:0:17736:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607619.851392:0:17736:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607619.851394:0:17736:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607619.851394:0:17736:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607619.851395:0:17736:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607619.851396:0:17736:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607619.851420:0:17736:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789607619.851438:0:17736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150097920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607619.851513:0:17736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607619.851550:0:17736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607619.852475:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150097920 00000100:00100000:0.0:1789607619.852485:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150097920 00000100:00100000:0.0:1789607619.852533:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789607619.852542:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:17736:x1876539150097920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607619.852567:0:16423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789607619.852579:0:16423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789607619.885705:0:16423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789607619.885717:0:16423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789607619.885735:0:16444:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789607619.885739:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789607619.885758:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.885776:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe894 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.885799:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.885807:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.885841:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.885853:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 21 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607619.885884:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150098048:0@lo:104: 00000100:00100000:3.0:1789607619.885972:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607619.886017:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe894 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886025:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe894 expref: 21 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607619.886034:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150098176:0@lo:104: 00000100:00100000:3.0:1789607619.886222:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.886243:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607619.886267:0:16412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607619.886283:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098048 00000100:00100000:3.0:1789607619.886288:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098048 00000100:00100000:3.0:1789607619.886318:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098176 00000100:00100000:3.0:1789607619.886320:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098176 00000100:00100000:3.0:1789607619.886335:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607619.886351:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:16444:x1876539150098048:12345-0@lo:104: 00010000:00010000:3.0:1789607619.886366:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886413:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607619.886419:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:16444:x1876539150098048:12345-0@lo:104: Request processed in 70us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.886426:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607619.886442:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607619.886448:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150098176:12345-0@lo:104: 00010000:00010000:3.0:1789607619.886456:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886507:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607619.886512:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150098176:12345-0@lo:104: Request processed in 65us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.886518:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789607619.886567:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607619.886573:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886580:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607619.886583:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886592:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607619.886599:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607619.886610:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607619.886640:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886646:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607619.886662:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886668:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9184a00/0xa26202d240fbe8a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8a9 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886680:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607619.886683:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886688:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8e00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607619.886690:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886696:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607619.886701:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607619.886705:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607619.886715:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886720:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607619.886740:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886746:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbe894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe89b expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.886757:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607619.886759:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607619.886761:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607619.886778:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150098304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607619.886808:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.886838:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607619.886845:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150098432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607619.886890:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607619.887277:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150098048:0@lo:104: 00000100:00100000:3.0:1789607619.887286:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150098176:0@lo:104: 00010000:00010000:3.0:1789607619.887303:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607619.891037:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098304 00000100:00100000:0.0:1789607619.891053:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098304 00010000:00010000:0.0:1789607619.891096:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 22 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607619.891132:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098432 00000100:00100000:0.0:1789607619.891136:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098432 00010000:00010000:0.0:1789607619.891147:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe894 expref: 23 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607619.891161:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607619.891169:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:3469:x1876539150098304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607619.891182:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607619.891188:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 23 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891199:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 23 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891215:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbe8a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe8a2 expref: 23 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891229:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607619.891294:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:3469:x1876539150098304:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.891313:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607619.891330:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607619.891336:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9244850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3471:x1876539150098432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607619.891343:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607619.891348:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe894 expref: 21 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891357:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe894 expref: 21 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891367:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbe89b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe894 expref: 21 pid: 16424 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891379:0:16415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891387:0:16415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607619.891403:0:16415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005664107s 00010000:00010000:0.0:1789607619.891408:0:16415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891415:0:16415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891421:0:16415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891427:0:16415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891439:0:16415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607619.891443:0:16415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891451:0:16415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891464:0:16415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607619.891475:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607619.891502:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9244850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:3471:x1876539150098432:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (4611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607619.891509:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789607619.891549:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607619.891791:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150098304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607619.891822:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150098432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607619.891841:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.891848:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607619.891854:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571fc00/0xa26202d240fbe951 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607619.899424:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:17736:x1876539150097920:12345-0@lo:253:mount.lustre.0 Request processed in 46872us (47901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607619.899439:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789607619.899520:0:17736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:17736:1876539150097920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607619.899535:0:17736:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789607619.899538:0:17736:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607619.899540:0:17736:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607619.899541:0:17736:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607619.899542:0:17736:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607619.899543:0:17736:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607619.899545:0:17736:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607619.899546:0:17736:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607619.899548:0:17736:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607619.899550:0:17736:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607619.899564:0:17736:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607619.902772:0:17736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607619.903285:0:17736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607619.903433:0:17736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607619.905253:0:17736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607619.905422:0:17736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607619.905612:0:17736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789607619.907457:0:17736:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789607619.960417:0:17736:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789607619.960427:0:17736:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789607619.960461:0:17736:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789607619.960520:0:17736:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789607619.960538:0:17736:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789607619.960561:0:17736:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789607620.515002:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789607621.538387:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607621.538395:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78d9435000 from 9 10000000:01000000:3.0:1789607621.538401:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607621.538447:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.538460:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.538470:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607621.538495:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607621.538560:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607621.538639:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0cab480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607621.541509:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098560 00000100:00100000:2.0:1789607621.541526:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098560 00000100:00100000:2.0:1789607621.541588:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789607621.541599:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78dbe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:16427:x1876539150098560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607621.541617:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607621.541648:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe958 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.541676:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe958 expref: 20 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.541687:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe958 expref: 20 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.541696:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580a00, rc 0) 00000100:00100000:2.0:1789607621.541769:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78dbe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:16427:x1876539150098560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607621.541775:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1789607621.541986:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607621.542055:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607621.542075:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.542086:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607621.542171:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789607621.542230:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607621.542270:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0cab480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607621.542406:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098688 00000100:00100000:1.0:1789607621.542411:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098688 00000100:00100000:1.0:1789607621.542450:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789607621.542459:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:16427:x1876539150098688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789607621.542474:0:16423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789607621.542494:0:16423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789607621.542497:0:16423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789607621.542587:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:16427:x1876539150098688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607621.542604:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789607621.542641:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607621.542698:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607621.542706:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.542717:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607621.542729:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607621.542731:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c419c000 from 9 10000000:01000000:1.0:1789607621.542734:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607621.542755:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.542762:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.542770:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607621.542784:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607621.542814:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607621.542832:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607621.542835:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098816 00000100:00100000:2.0:1789607621.542841:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098816 00000100:00100000:2.0:1789607621.542886:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789607621.542895:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:16427:x1876539150098816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607621.542904:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607621.542915:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbe966 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.542933:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbe966 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.542944:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe966 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.542964:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580800, rc 0) 00000100:00100000:2.0:1789607621.543368:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150098816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 474us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607621.543385:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789607621.543968:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607621.543988:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.544011:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607621.544070:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607621.544121:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607621.544167:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607621.544801:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150098944 00000100:00100000:3.0:1789607621.544809:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150098944 00000100:00100000:3.0:1789607621.544852:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607621.544878:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150098944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789607621.544896:0:16423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607621.544910:0:16423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607621.544912:0:16423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789607621.545016:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150098944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607621.545024:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789607621.545028:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150098944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607621.545087:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607621.545096:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.545271:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607621.923801:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607606/real 1789607606] req@ffff8d78f0703800 x1876539150085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607621.923833:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78f0703800 x1876539150085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607621.923844:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607606/real 1789607606] req@ffff8d78fcd82680 x1876539150085632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607621.923855:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fcd82680 x1876539150085632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789607621.923928:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607621.923943:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789607621.923955:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085888:0@lo:8:kworker.0 00000100:00080000:2.0:1789607621.923961:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607621.923967:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789607621.923970:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150085632:0@lo:8:kworker.0 00000100:00080000:3.0:1789607621.924092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607621.924097:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789607621.924099:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607621.924105:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:3.0:1789607621.924109:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789607621.924120:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78f567f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607621.924140:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd116d80 x1876539150099200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607621.924153:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607621.924156:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789607621.924157:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607621.924160:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:3.0:1789607621.924163:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789607621.924167:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607621.924190:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd114e00 x1876539150099328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607621.924222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607621.924225:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607621.924228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607621.924231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607621.924265:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150099456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607621.924338:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607621.924367:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150099968:0@lo:400:kworker.0 00000100:00100000:3.0:1789607621.924389:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607621.924411:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607621.924417:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150099584:0@lo:400:kworker.0 00000100:00100000:3.0:1789607621.924440:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607621.924476:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099456 00000100:00100000:3.0:1789607621.924482:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099456 00000100:00100000:3.0:1789607621.924516:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099968 00000100:00100000:3.0:1789607621.924518:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099968 00000100:00100000:3.0:1789607621.924549:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607621.924558:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607621.924604:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150099456:12345-0@lo:400:kworker.0 Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607621.924611:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607621.924628:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607621.924634:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607621.924662:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150099968:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607621.924675:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789607621.924723:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789607621.924747:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0703800 x1876539150099456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607621.924759:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150099456:0@lo:400:kworker.0 00010000:00080000:3.0:1789607621.924768:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0702300 x1876539150099968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607621.924776:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150099968:0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925124:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150099712:0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925155:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607621.925180:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789607621.925187:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150099072:0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925209:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607621.925230:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150099840:0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925254:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607621.925293:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099712 00000100:00100000:2.0:1789607621.925297:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099712 00000100:00100000:2.0:1789607621.925321:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099840 00000100:00100000:2.0:1789607621.925323:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099840 00000100:00100000:2.0:1789607621.925341:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607621.925347:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150099712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925383:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150099712:12345-0@lo:400:kworker.0 Request processed in 35us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607621.925389:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607621.925402:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607621.925408:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150099840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925433:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150099840:12345-0@lo:400:kworker.0 Request processed in 26us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607621.925438:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789607621.925457:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789607621.925475:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0702680 x1876539150099840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607621.925485:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150099840:0@lo:400:kworker.0 00010000:00080000:2.0:1789607621.925495:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0701180 x1876539150099712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607621.925502:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150099712:0@lo:400:kworker.0 00000100:00100000:2.0:1789607621.925523:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150099200:0@lo:8:kworker.0 00000100:00100000:2.0:1789607621.925549:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607621.925576:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150099328:0@lo:8:kworker.0 00000100:00100000:2.0:1789607621.925595:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607621.925635:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099200 00000100:00100000:2.0:1789607621.925639:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099200 00000100:00100000:2.0:1789607621.925661:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099328 00000100:00100000:2.0:1789607621.925663:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099328 00000100:00100000:2.0:1789607621.925671:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607621.925675:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150099200:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789607621.925712:0:17737:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1789607621.925738:0:17737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbe974 00002000:00100000:2.0:1789607621.925751:0:17737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d78c5296000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789607621.925756:0:17737:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789607621.925759:0:17737:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789607621.926105:0:17737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789607621.926128:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d78c5294000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607621.926171:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539150099200:12345-0@lo:8:kworker.0 Request processed in 493us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607621.926177:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607621.926191:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607621.926195:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150099328:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789607621.926208:0:17737:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789607621.927251:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099584 00000100:00100000:1.0:1789607621.927273:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099584 00000100:00100000:1.0:1789607621.927319:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150099072 00000100:00100000:1.0:1789607621.927322:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150099072 00000100:00100000:1.0:1789607621.927339:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607621.927346:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150099584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607621.927417:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150099584:12345-0@lo:400:kworker.0 Request processed in 72us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607621.927424:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607621.927441:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607621.927448:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150099072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607621.927484:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150099072:12345-0@lo:400:kworker.0 Request processed in 37us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607621.927501:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607621.927550:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150099072:0@lo:400:kworker.0 00000100:00100000:1.0:1789607621.927584:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150099584:0@lo:400:kworker.0 00010000:00080000:3.0:1789607621.931327:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd116d80 x1876539150099200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607621.931345:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607621.931355:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789607621.931363:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789607621.931369:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789607621.931372:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789607621.931400:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789607621.931406:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150099200:0@lo:8:kworker.0 00000004:00080000:1.0:1789607621.931532:0:16453:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789607621.931554:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16453:1876539150100224:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789607621.931614:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607621.931644:0:16453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c514ba80 going to sleep for 11 seconds 00000004:00080000:1.0:1789607621.931659:0:16452:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789607621.932182:0:16452:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 526889319066ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789607621.932475:0:17739:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789607621.932483:0:17739:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789607621.932578:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607621.932594:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607621.932637:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607621.932683:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100096 00000100:00100000:1.0:1789607621.932691:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100096 00000100:00100000:1.0:1789607621.932744:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607621.932754:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150100096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607621.932785:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607621.932829:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3468:x1876539150100096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607621.932837:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789607621.932880:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607621.932904:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78e9d0aa00 x1876539150100096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607621.932922:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607621.936215:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100224 00000100:00100000:1.0:1789607621.936229:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100224 00000100:00100000:3.0:1789607621.937455:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607621.937470:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16453:x1876539150100224:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789607621.949633:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150099328:12345-0@lo:8:kworker.0 Request processed in 23427us (24027us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607621.949648:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789607621.952832:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607621.952843:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607621.952848:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150099328:0@lo:8:kworker.0 00002000:00080000:3.0:1789607621.956552:0:17881:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789607621.956569:0:17881:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789607621.956575:0:17881:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:0.0:1789607621.978528:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789607621.980108:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789607621.980118:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980134:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1789607621.980139:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607621.980146:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980165:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980176:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980184:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980209:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607621.980238:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607621.980246:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980254:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607621.980259:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980268:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980287:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980295:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8940b4e/0xa26202d240fbe97b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980312:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607621.980314:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607621.980315:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789607621.980650:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789607621.980656:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980664:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1789607621.980667:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607621.980672:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980690:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980698:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980707:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.980726:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607621.980743:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607621.980749:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980757:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607621.980767:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980776:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980787:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980794:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c38b37/0xa26202d240fbe982 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.980807:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607621.980810:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607621.980811:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789607621.981450:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789607621.981457:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.981467:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1789607621.981471:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607621.981476:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.981486:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.981493:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.981512:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.983097:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607621.983422:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607621.983432:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.983445:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fa00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607621.983449:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.983460:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.983479:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.983494:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006996c089/0xa26202d240fbe989 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607621.983515:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607621.983517:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607621.983519:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607621.985297:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.985309:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.985326:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.985330:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.985336:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.985351:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.985374:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.985381:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.985634:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789607621.986206:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.986213:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.986224:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.986227:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.986232:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.986243:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.986252:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.986260:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986684:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607621.986693:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986701:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607621.986710:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986719:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986737:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986748:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c31651cf/0xa26202d240fbe990 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986763:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607621.986767:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986772:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607621.986775:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986783:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986791:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.986798:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.986803:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.986805:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607621.987050:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607621.987056:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc686416/0xa26202d240fbe997 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607621.987595:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.987602:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.987612:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.987616:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.987621:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.987631:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.987640:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.987648:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.987688:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607621.987694:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.987701:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607621.987704:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.987712:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.987724:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.987732:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.987734:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.987735:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607621.987857:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607621.987885:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084f69754/0xa26202d240fbe99e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607621.988414:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.988420:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.988430:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.988434:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.988439:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.988448:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.988457:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.988465:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.988528:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607621.988534:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.988541:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607621.988545:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.988553:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.988565:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.988573:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.988575:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.988577:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607621.988632:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607621.988637:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c532fe1/0xa26202d240fbe9a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607621.989067:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.989073:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.989092:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.989095:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.989262:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.989275:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.989284:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.989292:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.989405:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607621.989411:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.989419:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607621.989428:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.989437:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.989449:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.989457:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.989459:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.989460:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607621.989515:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607621.989520:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb9319a/0xa26202d240fbe9ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.990184:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607621.990213:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.990220:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990230:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.990234:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.990239:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990260:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990269:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990276:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990325:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789607621.990751:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.990757:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990766:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.990769:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.990773:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990783:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990792:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.990810:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.990838:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607621.990844:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.990851:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607621.990855:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.990991:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991007:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991014:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f10a6a/0xa26202d240fbe9b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.991098:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607621.991433:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607621.991439:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991447:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607621.991451:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991459:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991471:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991478:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b480bf7e/0xa26202d240fbe9ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.991492:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.991493:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.991495:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.991522:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.991524:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607621.991525:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607621.992002:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.992010:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992020:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.992023:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.992028:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992038:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992046:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992054:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992095:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789607621.992470:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607621.992476:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992489:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1789607621.992492:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607621.992496:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992505:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992513:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607621.992520:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993073:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607621.993081:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993089:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607621.993158:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993168:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993184:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993192:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064c61b28/0xa26202d240fbe9c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993213:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607621.993215:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993221:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607621.993224:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993232:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993241:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607621.993248:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.993255:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607621.993258:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607621.998875:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789607621.998894:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aec3f0f/0xa26202d240fbe9c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607621.999096:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.001696:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.001707:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.001723:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.001727:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.001734:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.001749:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.001760:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.001768:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.001797:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607622.002205:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607622.002213:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607622.002222:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607622.002226:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607622.002236:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607622.002248:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789607622.002254:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.002258:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607622.002262:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e8d7ea/0xa26202d240fbe9cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.002267:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.002269:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.002273:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607622.002279:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607622.002281:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607622.002282:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607622.002282:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.002289:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.002296:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.002317:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607622.002342:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607622.002348:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.002355:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607622.002364:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.002372:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.002383:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.002391:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbe9d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.002405:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607622.002406:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607622.002408:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.003345:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.003354:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.003364:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.003368:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.003372:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.003382:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.003398:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.003405:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.003421:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607622.003976:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.003984:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.003993:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.003996:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.004000:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004010:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004018:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004024:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004061:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789607622.004086:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607622.004094:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004113:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.004117:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004137:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004152:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004160:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000722cad5/0xa26202d240fbe9dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004177:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607622.004181:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004187:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.004190:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004198:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004208:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004216:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbe9e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004240:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.004242:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.004244:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.004433:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.004438:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004447:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.004450:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.004454:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004463:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004470:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004477:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.004498:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607622.004791:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607622.004797:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004804:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.004808:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004816:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004827:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004834:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a7a0107/0xa26202d240fbe9eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.004848:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.004849:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.004851:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607622.005127:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.008212:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.008226:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008242:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.008250:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.008257:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008271:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008281:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008290:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008313:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607622.008322:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607622.008329:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008348:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.008353:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008362:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008378:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008386:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c8f47e9/0xa26202d240fbe9f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008407:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.008408:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.008410:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.008696:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.008702:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008710:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.008713:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.008717:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008726:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008734:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008746:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.008768:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607622.008887:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607622.008894:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008902:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.008905:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008914:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008943:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008960:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001759cb20/0xa26202d240fbe9f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.008974:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.008976:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.008978:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.009172:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.009178:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009185:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.009188:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.009192:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009200:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009206:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009212:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009232:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607622.009601:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.009607:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009620:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.009623:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.009627:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009635:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009643:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009650:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.009661:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789607622.010066:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.010071:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.010079:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.010082:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.010086:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.010095:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.010114:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.010121:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.010129:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789607622.013679:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789607622.013694:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013708:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.013714:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013725:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013746:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013754:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000737aa8f7/0xa26202d240fbea00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013792:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607622.013796:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013803:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.013806:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013814:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013825:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013832:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbea07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013844:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607622.013848:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013854:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.013858:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013894:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013906:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013914:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a87258e5/0xa26202d240fbea0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.013928:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.013929:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.013931:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.013939:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.014437:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.014445:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.014457:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.014462:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.014468:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.014479:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.014488:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.014496:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.014536:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607622.015075:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.015081:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015090:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.015093:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.015096:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015104:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015111:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015118:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015130:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789607622.015138:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607622.015145:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015153:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607622.015157:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015166:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015180:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015193:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008063c7fb/0xa26202d240fbea15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015208:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607622.015210:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015217:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607622.015220:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015228:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015238:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015246:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbea1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.015257:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607622.015258:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607622.015260:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607622.015499:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.015505:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015513:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.015521:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.015525:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.015534:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.015659:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607622.016943:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.016963:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.016986:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607622.017458:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.017464:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.017475:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.017479:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.017484:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.017495:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.017503:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.017516:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.017634:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789607622.018010:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.018016:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.018025:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.018028:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.018032:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.018042:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.018049:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.018056:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.021889:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789607622.021903:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.021917:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.021923:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.021935:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.021967:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.021982:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004489f41a/0xa26202d240fbea23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022006:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607622.022010:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022015:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.022019:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022026:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022036:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022043:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbea2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022054:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607622.022058:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022063:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607622.022072:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022079:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022090:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607622.022097:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.022099:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607622.022100:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607622.025656:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789607622.025670:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbea31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607622.026348:0:17881:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607622.026356:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.026369:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1789607622.026373:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607622.026380:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.026393:0:17881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.026402:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.026409:0:17881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607622.026418:0:17881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607622.026918:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607622.027044:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.027061:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607622.027066:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.027075:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.027095:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.027102:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a96e3b0/0xa26202d240fbea38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607622.027117:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607622.027119:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607622.027121:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789607622.027443:0:17881:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789607622.027538:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16453:x1876539150100224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90069us (95920us total) trans 0 rc 0/0 00010000:00010000:0.0:1789607622.027639:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607622.027789:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16453:1876539150100224:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789607622.027804:0:16453:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789607622.027888:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16453:1876539150100352:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789607622.028082:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607622.028281:0:16453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c7194300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607622.028647:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607622.028679:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100352 00000100:00100000:1.0:1789607622.028686:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100352 00000100:00100000:3.0:1789607622.031808:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607622.032522:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:16453:x1876539150100352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789607622.032577:0:17739:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:3.0:1789607622.046400:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:16453:x1876539150100352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14572us (18310us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789607622.046413:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607622.046490:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16453:1876539150100352:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789607622.046506:0:16453:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1789607622.565646:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607622.885694:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150100480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607622.885776:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607622.885823:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607622.885830:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150100608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607622.885852:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607622.885910:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100480 00000100:00100000:1.0:1789607622.885928:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100480 00000100:00100000:1.0:1789607622.885974:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100608 00000100:00100000:1.0:1789607622.885978:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100608 00000100:00100000:1.0:1789607622.885994:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607622.886002:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150100480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607622.886041:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607622.886086:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150100480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607622.886103:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607622.886121:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607622.886127:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150100608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607622.886146:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607622.886178:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150100608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607622.886184:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607622.886222:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150100608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607622.886233:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150100480:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789607623.587250:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607624.609979:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789607625.073414:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789607625.073426:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789607625.637855:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607625.905344:0:18108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789607626.660663:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607626.978009:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607626.978015:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789607626.978019:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607626.978036:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1789607626.978043:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789607626.978056:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607626.978085:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f0701180 x1876539150101120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607626.978115:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607626.978118:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607626.978121:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607626.978125:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607626.978160:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150100864:0@lo:400:kworker.0 00000100:00100000:3.0:1789607626.978218:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607626.978265:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150101504:0@lo:400:kworker.0 00000100:00100000:3.0:1789607626.978289:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607626.978312:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789607626.978317:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150100736:0@lo:400:kworker.0 00000100:00100000:3.0:1789607626.978345:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607626.978366:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150101376:0@lo:400:kworker.0 00000100:00100000:3.0:1789607626.978385:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607626.978722:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150100992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.978753:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607626.978788:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150101632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.978814:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607626.978833:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789607626.978838:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150101248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.978856:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607626.978893:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150101760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.978948:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607626.978979:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100864 00000100:00100000:1.0:1789607626.978985:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100864 00000100:00100000:1.0:1789607626.979022:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101376 00000100:00100000:1.0:1789607626.979037:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101376 00000100:00100000:1.0:1789607626.979055:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607626.979216:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979273:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150100864:12345-0@lo:400:kworker.0 Request processed in 211us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.979280:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607626.979297:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607626.979304:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150101376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979330:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150101376:12345-0@lo:400:kworker.0 Request processed in 27us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.979336:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607626.979355:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101504 00000100:00100000:1.0:1789607626.979360:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101504 00000100:00100000:1.0:1789607626.979377:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101632 00000100:00100000:1.0:1789607626.979380:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101632 00000100:00100000:1.0:1789607626.979400:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101248 00000100:00100000:1.0:1789607626.979403:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101248 00000100:00100000:1.0:1789607626.979412:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101760 00000100:00100000:1.0:1789607626.979420:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101760 00000100:00100000:1.0:1789607626.979441:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607626.979446:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150101504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979477:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150101504:12345-0@lo:400:kworker.0 Request processed in 30us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.979483:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607626.979494:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607626.979500:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150101632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979529:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150101632:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.979535:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607626.979546:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607626.979551:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150101248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979577:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150101248:12345-0@lo:400:kworker.0 Request processed in 25us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.979582:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607626.979593:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607626.979600:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150101760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979625:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150101760:12345-0@lo:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.979630:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789607626.979653:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607626.979656:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607626.979678:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0702680 x1876539150101248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607626.979692:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150101248:0@lo:400:kworker.0 00010000:00080000:1.0:1789607626.979712:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cffaf480 x1876539150101760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607626.979720:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150101760:0@lo:400:kworker.0 00010000:00080000:1.0:1789607626.979729:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cfface00 x1876539150101632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607626.979736:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150101632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979769:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150101376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.979778:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150100864:0@lo:400:kworker.0 00010000:00080000:1.0:1789607626.979787:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cffac700 x1876539150101504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607626.979795:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150101504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607626.981256:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150101888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607626.981303:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607626.981342:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101888 00000100:00100000:1.0:1789607626.981349:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101888 00000100:00100000:1.0:1789607626.981388:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607626.981395:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150101888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607626.981426:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607626.981462:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150101888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607626.981469:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789607626.981485:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607626.981501:0:3468:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789607626.981527:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150101888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607626.981579:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100992 00000100:00100000:2.0:1789607626.981584:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100992 00000100:00100000:2.0:1789607626.981620:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607626.981627:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150100992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607626.981666:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150100992:12345-0@lo:400:kworker.0 Request processed in 39us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607626.981672:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607626.981694:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150101120:0@lo:8:kworker.0 00000100:00100000:2.0:1789607626.981720:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607626.981753:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150100736 00000100:00100000:2.0:1789607626.981757:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150100736 00000100:00100000:2.0:1789607626.981780:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789607626.981786:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d79020c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3469:x1876539150100736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607626.981818:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d79020c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3469:x1876539150100736:12345-0@lo:400:kworker.0 Request processed in 32us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607626.981824:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789607626.983055:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150101120 00000100:00100000:1.0:1789607626.983074:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150101120 00000100:00100000:1.0:1789607626.983098:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607626.983105:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150101120:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789607626.983124:0:17740:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607626.988157:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150100992:0@lo:400:kworker.0 00000100:00100000:0.0:1789607627.002166:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150100736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607627.010499:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150101120:12345-0@lo:8:kworker.0 Request processed in 27385us (28769us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607627.010513:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789607627.010961:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607627.010967:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607627.010971:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150101120:0@lo:8:kworker.0 00010000:00010000:3.0:1789607627.700814:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607628.003217:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607628.003235:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607628.003312:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607628.003356:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102016 00000100:00100000:1.0:1789607628.003364:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102016 00000100:00100000:1.0:1789607628.003410:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607628.003420:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150102016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607628.003458:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607628.003504:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150102016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607628.003511:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607628.003556:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150102016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607628.004138:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607628.004149:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150102144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607628.004181:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607628.004212:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102144 00000100:00100000:0.0:1789607628.004217:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102144 00000100:00100000:0.0:1789607628.004246:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789607628.004253:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150102144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607628.004342:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607628.004382:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150102144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607628.004403:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789607628.004435:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150102144:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789607628.067665:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607628.707717:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607629.737644:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607629.925712:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607630.754507:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607631.778297:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607632.099413:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607617/real 1789607617] req@ffff8d78fcd82300 x1876539150094336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607632.099443:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fcd82300 x1876539150094336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607632.099455:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607617/real 1789607617] req@ffff8d78fcd83800 x1876539150094464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607632.099480:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78fcd83800 x1876539150094464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789607632.099499:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607632.099507:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607632.099511:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150094336:0@lo:8:kworker.0 00000100:00080000:3.0:1789607632.099517:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607632.099522:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607632.099525:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150094464:0@lo:8:kworker.0 00000100:00100000:3.0:1789607632.099556:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150102272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607632.099619:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.099688:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102272 00000100:00100000:3.0:1789607632.099696:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102272 00000100:00080000:1.0:1789607632.099735:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607632.099741:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607632.099744:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607632.099750:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00100000:3.0:1789607632.099758:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789607632.099766:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1789607632.099769:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150102272:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789607632.099779:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607632.099801:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78e9d0ad80 x1876539150102656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607632.099833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607632.099836:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789607632.099838:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607632.099841:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1789607632.099844:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789607632.099848:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d78fcb5f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607632.099907:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78e9d09180 x1876539150103040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607632.099917:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607632.099919:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607632.099921:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607632.099924:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1789607632.099926:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789607632.099930:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78e0099000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607632.099941:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78e9d09f80 x1876539150103168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000024:3.0:1789607632.099961:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607632.099984:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150102400:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100008:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150102272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607632.100027:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789607632.100110:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607632.100123:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150102528:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100155:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100183:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150103424:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100210:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100249:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150102784:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100273:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100291:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150103552:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100310:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100327:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607632.100333:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150102912:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100353:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100379:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102528 00000100:00100000:3.0:1789607632.100383:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102528 00000100:00100000:3.0:1789607632.100408:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102912 00000100:00100000:3.0:1789607632.100411:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102912 00000100:00100000:3.0:1789607632.100427:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607632.100433:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150102528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100474:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150102528:12345-0@lo:400:kworker.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607632.100480:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607632.100490:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607632.100496:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150102912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100527:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150102912:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607632.100540:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607632.100576:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150102528:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100609:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150102272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607632.100633:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150102912:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100654:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150102656:0@lo:8:kworker.0 00000100:00100000:3.0:1789607632.100680:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100700:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150103040:0@lo:8:kworker.0 00000100:00100000:3.0:1789607632.100723:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.100747:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150103168:0@lo:8:kworker.0 00000100:00100000:1.0:1789607632.100754:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.100784:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150103296:0@lo:400:kworker.0 00000100:00100000:3.0:1789607632.100796:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.100814:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.100981:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103424 00000100:00100000:1.0:1789607632.100986:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103424 00000100:00100000:1.0:1789607632.101093:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102784 00000100:00100000:1.0:1789607632.101097:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102784 00000100:00100000:1.0:1789607632.101111:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103552 00000100:00100000:1.0:1789607632.101114:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103552 00000100:00100000:1.0:1789607632.101125:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103296 00000100:00100000:1.0:1789607632.101127:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103296 00000100:00100000:1.0:1789607632.101138:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607632.101144:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150103424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607632.101187:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150103424:12345-0@lo:400:kworker.0 Request processed in 44us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607632.101193:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607632.101206:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607632.101211:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150102784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607632.101239:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150102784:12345-0@lo:400:kworker.0 Request processed in 28us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607632.101244:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607632.101255:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607632.101260:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150103552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607632.101281:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150103552:12345-0@lo:400:kworker.0 Request processed in 22us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607632.101286:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607632.101295:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607632.101300:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150103296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607632.101327:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150103296:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607632.101343:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607632.101367:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102400 00000100:00100000:1.0:1789607632.101371:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102400 00000100:00100000:1.0:1789607632.101392:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789607632.101398:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d277b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3468:x1876539150102400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607632.101423:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d277b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3468:x1876539150102400:12345-0@lo:400:kworker.0 Request processed in 26us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607632.101428:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789607632.101453:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607632.101456:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607632.101777:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150102656 00000100:00100000:2.0:1789607632.101778:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103040 00000100:00100000:3.0:1789607632.101783:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150102656 00000100:00100000:2.0:1789607632.101785:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103040 00000100:00100000:2.0:1789607632.101813:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103168 00000100:00100000:3.0:1789607632.101819:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607632.101825:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103168 00000100:00100000:3.0:1789607632.101829:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150103040:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789607632.101846:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789607632.101857:0:17737:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:3.0:1789607632.101910:0:17737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbea3f 00002000:00100000:3.0:1789607632.101924:0:17737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d78f5861800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789607632.101929:0:17737:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789607632.101932:0:17737:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789607632.101940:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3467:x1876539150102656:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789607632.101956:0:17881:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607632.102003:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3467:x1876539150102656:12345-0@lo:8:kworker.0 Request processed in 150us (1322us total) trans 0 rc -19/-19 00000100:00080000:0.0:1789607632.102032:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607632.102039:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607632.102043:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150102656:0@lo:8:kworker.0 00010000:00080000:0.0:1789607632.102205:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0701180 x1876539150103424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607632.102219:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150103424:0@lo:400:kworker.0 00010000:00080000:0.0:1789607632.102258:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78e9d09500 x1876539150102784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607632.102269:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150102784:0@lo:400:kworker.0 00010000:00080000:0.0:1789607632.102284:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0702300 x1876539150103552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607632.102295:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150103552:0@lo:400:kworker.0 00000100:00100000:0.0:1789607632.102334:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150102400:0@lo:400:kworker.0 00010000:00080000:0.0:1789607632.102368:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78e9d08a80 x1876539150103296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607632.102375:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150103296:0@lo:400:kworker.0 00002000:00080000:3.0:1789607632.102394:0:17737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:2.0:1789607632.102532:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607632.102552:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607632.102557:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3467:x1876539150103168:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789607632.102569:0:17881:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607632.102685:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3467:x1876539150103168:12345-0@lo:8:kworker.0 Request processed in 126us (1890us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607632.102691:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789607632.102747:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607632.102753:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607632.102762:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150103168:0@lo:8:kworker.0 00000100:00080000:3.0:1789607632.102796:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d78f5864800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607632.102852:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539150103040:12345-0@lo:8:kworker.0 Request processed in 1024us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607632.102910:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607632.103011:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607632.103018:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789607632.103025:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789607632.103030:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789607632.103033:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789607632.103138:0:17071:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789607632.103159:0:17071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17071:1876539150103808:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789607632.103191:0:17071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.103199:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150103680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607632.103212:0:17071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607632.103238:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.103282:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103808 00000100:00100000:1.0:1789607632.103288:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103808 00000100:00100000:1.0:1789607632.103323:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607632.103329:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17071:x1876539150103808:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789607632.103688:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103680 00000100:00100000:2.0:1789607632.103692:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103680 00000100:00100000:2.0:1789607632.103719:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607632.103725:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3471:x1876539150103680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607632.103738:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607632.103778:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3471:x1876539150103680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607632.103785:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1789607632.114017:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789607632.114035:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150103040:0@lo:8:kworker.0 00002000:00080000:1.0:1789607632.114847:0:17740:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789607632.114854:0:17740:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789607632.114985:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17071:x1876539150103808:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11653us (11791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607632.114994:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789607632.115043:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607632.115069:0:17071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17071:1876539150103808:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789607632.115082:0:17071:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789607632.115088:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150103680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607632.115122:0:17071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17071:1876539150103936:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789607632.115156:0:17071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.115187:0:17071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607632.115496:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150103936 00000100:00100000:0.0:1789607632.115504:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150103936 00000100:00100000:0.0:1789607632.115549:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607632.115559:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17071:x1876539150103936:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789607632.115589:0:17737:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789607632.115627:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17071:x1876539150103936:12345-0@lo:5:osp-pre-0-1.0 Request processed in 70us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607632.115633:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:2.0:1789607632.120126:0:17070:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789607632.120523:0:17070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 537077659837ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789607632.134369:0:17071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17071:1876539150103936:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789607632.134389:0:17071:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789607632.134438:0:17071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17071:1876539150104064:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789607632.134509:0:17071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607632.134544:0:17071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607632.134822:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104064 00000100:00100000:1.0:1789607632.134828:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104064 00000100:00100000:1.0:1789607632.134900:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607632.134908:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17071:x1876539150104064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789607632.134948:0:17881:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789607632.175451:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:17071:x1876539150104064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40536us (40935us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789607632.175464:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607632.175772:0:17071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17071:1876539150104064:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789607632.175788:0:17071:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789607632.175832:0:17071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17071:1876539150104192:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789607632.175898:0:17071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607632.175922:0:17071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607632.177940:0:16440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104192 00000100:00100000:3.0:1789607632.177963:0:16440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104192 00000100:00100000:3.0:1789607632.178030:0:16440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607632.178040:0:16440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17071:x1876539150104192:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789607632.178123:0:16440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17071:x1876539150104192:12345-0@lo:900:osp-pre-0-1.0 Request processed in 85us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607632.178130:0:16440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789607632.178173:0:17071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cffaf100 x1876539150104192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607648 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607632.178187:0:17071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17071:1876539150104192:0@lo:900:osp-pre-0-1.0 00000004:00080000:3.0:1789607632.198382:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:0.0:1789607632.802120:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607633.124006:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607633.124031:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150104320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607633.124094:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607633.124143:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104320 00000100:00100000:1.0:1789607633.124151:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104320 00000100:00100000:1.0:1789607633.124197:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607633.124206:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150104320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607633.124243:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607633.124288:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150104320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.124294:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607633.124347:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150104320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607633.138103:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607633.138125:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150104448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607633.138186:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607633.138236:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104448 00000100:00100000:3.0:1789607633.138243:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104448 00000100:00100000:3.0:1789607633.138283:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607633.138292:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150104448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607633.138337:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607633.138382:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150104448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.138389:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607633.138437:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150104448:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1789607633.273400:0:18460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789607633.273404:0:18460:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789607633.273519:0:18460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d78fd000800 00000020:01000004:3.0:1789607633.273534:0:18460:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789607633.273550:0:18460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789607633.273564:0:18460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d78f9d299c0) 00000020:00000080:3.0:1789607633.273581:0:18460:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789607633.323818:0:18460:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789607633.324194:0:18460:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789607633.324950:0:18460:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789607633.325205:0:18460:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789607633.325404:0:18460:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789607633.325733:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:3.0:1789607633.327574:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 551: rc = 0 00100000:10000000:3.0:1789607633.327753:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 551: rc = 0 00100000:10000000:3.0:1789607633.328514:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 689: rc = 0 00100000:10000000:3.0:1789607633.329405:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 689: rc = 0 00100000:10000000:3.0:1789607633.329683:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 689: rc = 0 00100000:10000000:3.0:1789607633.330395:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 689: rc = 0 00100000:10000000:3.0:1789607633.330651:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 689: rc = 0 00100000:10000000:3.0:1789607633.330944:0:18460:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 689: rc = 0 00000020:00000080:3.0:1789607633.331520:0:18460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789607633.331536:0:18460:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607633.331547:0:18460:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa26202d240fbea4d 00000020:01000004:3.0:1789607633.331555:0:18460:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789607633.331575:0:18460:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789607633.331578:0:18460:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789607633.331584:0:18460:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789607633.331604:0:18460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789607633.331608:0:18460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789607633.354696:0:18460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789607633.354735:0:18460:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789607633.354739:0:18460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789607633.354741:0:18460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607633.354742:0:18460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607633.354743:0:18460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607633.354745:0:18460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607633.354746:0:18460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607633.354747:0:18460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607633.354748:0:18460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607633.354749:0:18460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607633.354753:0:18460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789607633.354755:0:18460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607633.354757:0:18460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607633.354758:0:18460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607633.354759:0:18460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607633.354760:0:18460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607633.354761:0:18460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607633.354762:0:18460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607633.354762:0:18460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607633.354763:0:18460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607633.354982:0:18460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789607633.355067:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607633.355208:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607633.355333:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.355502:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104576 00000100:00100000:1.0:1789607633.355511:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104576 00000100:00100000:1.0:1789607633.355594:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789607633.355604:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:18460:x1876539150104576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607633.355641:0:16421:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789607633.355644:0:16421:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789607633.355647:0:16421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789607633.372941:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:18460:x1876539150104576:12345-0@lo:253:mount.lustre.0 Request processed in 17329us (17724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607633.372956:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789607633.373219:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789607633.373234:0:18460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789607633.373238:0:18460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607633.373239:0:18460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607633.373241:0:18460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607633.373242:0:18460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607633.373244:0:18460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607633.373245:0:18460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607633.373246:0:18460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607633.373261:0:18460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607633.373263:0:18460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607633.373282:0:18460:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d78fd000800 from lustre-OST0001 10000000:01000000:0.0:1789607633.373304:0:18460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789607633.373307:0:18460:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789607633.373385:0:18460:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78fd3f3380 local copy 00010000:00010000:0.0:1789607633.373396:0:18460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607633.373615:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607633.373654:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.373755:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607633.374300:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104704 00000100:00100000:2.0:1789607633.374307:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104704 00000100:00100000:2.0:1789607633.374363:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789607633.374372:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d277b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:18460:x1876539150104704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607633.374537:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d277b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:18460:x1876539150104704:12345-0@lo:501:mount.lustre.0 Request processed in 166us (881us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607633.374550:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789607633.374794:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104704:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789607633.374822:0:18460:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789607633.375236:0:18460:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789607633.375244:0:18460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.375254:0:18460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607633.375279:0:18460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78fd000800 10000000:01000000:0.0:1789607633.375284:0:18460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789607633.375289:0:18460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789607633.375292:0:18460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607633.375296:0:18460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789607633.375299:0:18460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789607633.375336:0:18460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.375356:0:18460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.375366:0:18460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607633.375383:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607633.375420:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.375444:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607633.375615:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104832 00000100:00100000:3.0:1789607633.375621:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104832 00000100:00100000:3.0:1789607633.375649:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607633.375656:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:18460:x1876539150104832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607633.375666:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607633.375679:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571f200/0xa26202d240fbea5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbea54 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.375701:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571f200/0xa26202d240fbea5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbea54 expref: 22 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.375711:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571f200/0xa26202d240fbea5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbea54 expref: 22 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.375719:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571f200, rc 0) 00000100:00100000:3.0:1789607633.375760:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150104832:12345-0@lo:101:mount.lustre.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.375767:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789607633.376224:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607633.376238:0:18460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.376247:0:18460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607633.377407:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789607633.379617:0:18460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607633.380298:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789607633.380353:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789607633.380387:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789607633.380432:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789607633.380466:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789607633.380497:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789607633.380562:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789607633.380569:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789607633.380644:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607633.380704:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.380760:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.381726:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150104960 00000100:00100000:1.0:1789607633.381735:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150104960 00000100:00100000:1.0:1789607633.381786:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789607633.381796:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150104960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607633.382399:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150104960:12345-0@lo:501:mount.lustre.0 Request processed in 604us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.382407:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789607633.382514:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150104960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607633.382556:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607633.382599:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.382621:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.384305:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105088 00000100:00100000:1.0:1789607633.384316:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105088 00000100:00100000:1.0:1789607633.384372:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789607633.384381:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607633.384717:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105088:12345-0@lo:503:mount.lustre.0 Request processed in 336us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.384725:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789607633.384836:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607633.385562:0:18460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607633.385634:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607633.385683:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.385711:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.386366:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105216 00000100:00100000:1.0:1789607633.386374:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105216 00000100:00100000:1.0:1789607633.386416:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789607633.386425:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607633.386650:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105216:12345-0@lo:502:mount.lustre.0 Request processed in 226us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.386657:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789607633.387447:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.387739:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789607633.387793:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789607633.388245:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789607633.388300:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789607633.388339:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789607633.388369:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789607633.388407:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789607633.388434:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789607633.388486:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789607633.388522:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607633.388577:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.388605:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.388943:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105344 00000100:00100000:1.0:1789607633.388950:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105344 00000100:00100000:1.0:1789607633.389095:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789607633.389122:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607633.389289:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105344:12345-0@lo:502:mount.lustre.0 Request processed in 177us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.389296:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789607633.391137:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.391265:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789607633.391280:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789607633.392411:0:18461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789607633.392420:0:18461:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789607633.392427:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607633.392429:0:18461:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789607633.392435:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789607633.392449:0:18461:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d78e9eecd40) 00000020:00000080:0.0:1789607633.392472:0:18461:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789607633.392478:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789607633.392536:0:18461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78fd000800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789607633.392544:0:18461:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789607633.392566:0:18461:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa26202d240fbea69 00010000:00010000:0.0:1789607633.401967:0:18461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789607633.403621:0:18461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789607633.411383:0:18461:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789607633.415527:0:18461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789607633.415539:0:18461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607633.415544:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607633.415546:0:18461:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789607633.415549:0:18461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607633.415553:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607633.415554:0:18461:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607633.415557:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607633.415559:0:18461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789607633.415561:0:18461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607633.415563:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607633.415564:0:18461:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789607633.415567:0:18461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607633.415568:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607633.415570:0:18461:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789607633.415573:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789607633.415629:0:18461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607633.415632:0:18461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607633.415633:0:18461:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789607633.415646:0:18461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789607633.417717:0:18460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789607633.417753:0:18460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789607633.417776:0:18460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.417806:0:18460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607633.417815:0:18460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78fd000800 from 1 10000000:01000000:3.0:1789607633.417818:0:18460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607633.418099:0:18460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.418108:0:18460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.418204:0:18460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607633.418267:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607633.418385:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607633.418419:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789607633.418487:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105472 00000100:00100000:0.0:1789607633.418495:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105472 00000100:00100000:0.0:1789607633.418543:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789607633.418551:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150105472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607633.418565:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607633.418578:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbea70 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.418600:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbea70 expref: 23 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.418610:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbea70 expref: 23 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.418618:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075da00, rc 0) 00000100:00100000:0.0:1789607633.418661:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105472:12345-0@lo:101:mount.lustre.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.418667:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789607633.418965:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607633.418980:0:18460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.420383:0:18460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607633.427595:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789607633.433728:0:18460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607633.434631:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789607633.434685:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789607633.434761:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789607633.434770:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789607633.435490:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607633.435560:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607633.435651:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607633.437830:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105600 00000100:00100000:2.0:1789607633.437851:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105600 00000100:00100000:2.0:1789607633.437929:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789607633.437939:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607633.438721:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105600:12345-0@lo:501:mount.lustre.0 Request processed in 782us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607633.438729:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789607633.440118:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607633.448348:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607633.448442:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607633.448484:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.451541:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105728 00000100:00100000:1.0:1789607633.451555:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105728 00000100:00100000:1.0:1789607633.451621:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607633.451631:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607633.451899:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105728:12345-0@lo:503:mount.lustre.0 Request processed in 269us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.451907:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789607633.452463:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789607633.453687:0:18460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607633.453781:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607633.454722:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607633.454761:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.454883:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105856 00000100:00100000:1.0:1789607633.454891:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105856 00000100:00100000:1.0:1789607633.454937:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789607633.454946:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607633.455145:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105856:12345-0@lo:502:mount.lustre.0 Request processed in 200us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.455152:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789607633.455368:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.455613:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789607633.455665:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789607633.455710:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789607633.455742:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789607633.455791:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789607633.455850:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789607633.455924:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789607633.455956:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789607633.456585:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789607633.456648:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789607633.456697:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789607633.456742:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607633.459288:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.459394:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607633.460373:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150105984 00000100:00100000:3.0:1789607633.460386:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150105984 00000100:00100000:3.0:1789607633.460450:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789607633.460460:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607633.460715:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150105984:12345-0@lo:502:mount.lustre.0 Request processed in 255us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.460723:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789607633.461068:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150105984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.461239:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789607633.461257:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789607633.463193:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607633.463205:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463208:0:18465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789607633.463215:0:18465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78fd000800 00000020:00000080:1.0:1789607633.463218:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607633.463225:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607633.463228:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463229:0:18465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789607633.463231:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607633.463234:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463242:0:18465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789607633.463247:0:18465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78fd000800 00000020:00000080:1.0:1789607633.463249:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607633.463303:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607633.463307:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463309:0:18465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789607633.463312:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607633.463325:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463327:0:18465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607633.463331:0:18465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78fd000800 00000020:00000080:1.0:1789607633.463333:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607633.463351:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607633.463354:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463356:0:18465:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607633.463358:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607633.463360:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463362:0:18465:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789607633.463365:0:18465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78fd000800 00000020:00000080:1.0:1789607633.463367:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607633.463399:0:18465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607633.463403:0:18465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607633.463404:0:18465:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789607633.463407:0:18465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789607633.465169:0:18460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789607633.465209:0:18460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607633.465233:0:18460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.465246:0:18460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607633.465295:0:18460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789607633.465298:0:18460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78fd000800 10000000:01000000:0.0:1789607633.465301:0:18460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78fd000800 10000000:01000000:0.0:1789607633.465305:0:18460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607633.465311:0:18460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78fd000800 from 1 10000000:01000000:0.0:1789607633.465313:0:18460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607633.465361:0:18460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.465370:0:18460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.465380:0:18460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607633.465414:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607633.465476:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.465518:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607633.466119:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106112 00000100:00100000:3.0:1789607633.466127:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106112 00000100:00100000:3.0:1789607633.466178:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607633.466187:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:18460:x1876539150106112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607633.466201:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607633.466214:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbea85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbea7e expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.466237:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbea85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbea7e expref: 24 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.466247:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbea85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbea7e expref: 24 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607633.466255:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571ec00, rc 0) 00000100:00100000:3.0:1789607633.466306:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106112:12345-0@lo:101:mount.lustre.0 Request processed in 120us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.466313:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789607633.468118:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607633.468141:0:18460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.468153:0:18460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607633.468760:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789607633.469159:0:18460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607633.469415:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789607633.469458:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789607633.469492:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789607633.469547:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789607633.469584:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789607633.469631:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789607633.469667:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789607633.469702:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789607633.469774:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789607633.469812:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789607633.469845:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789607633.469937:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789607633.469976:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789607633.472146:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789607633.472237:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789607633.472276:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789607633.472308:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789607633.472382:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789607633.472420:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789607633.472451:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789607633.472497:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789607633.472533:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789607633.472566:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789607633.472614:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789607633.472666:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789607633.472703:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789607633.474252:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789607633.474302:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789607633.475665:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789607633.475749:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789607633.475789:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789607633.475823:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789607633.475857:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789607633.475932:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789607633.475983:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789607633.476042:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789607633.476080:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789607633.476113:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789607633.476163:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1789607633.476197:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1789607633.476247:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1789607633.476278:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1789607633.476343:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1789607633.476378:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1789607633.476407:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1789607633.476447:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1789607633.476538:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1789607633.476545:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1789607633.476642:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607633.476708:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.476751:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.477832:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106240 00000100:00100000:1.0:1789607633.477843:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106240 00000100:00100000:1.0:1789607633.477919:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789607633.477929:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607633.478168:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106240:12345-0@lo:501:mount.lustre.0 Request processed in 241us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.478176:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789607633.479803:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607633.480470:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607633.480547:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.480589:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106368 00000100:00100000:0.0:1789607633.480595:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106368 00000100:00100000:0.0:1789607633.480641:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789607633.480650:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607633.481111:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106368:12345-0@lo:503:mount.lustre.0 Request processed in 461us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.481119:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789607633.481169:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607633.481184:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106368:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607633.482168:0:18460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607633.482237:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607633.482287:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.482312:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607633.482464:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106496 00000100:00100000:1.0:1789607633.482471:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106496 00000100:00100000:1.0:1789607633.482505:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607633.482513:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607633.482690:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106496:12345-0@lo:502:mount.lustre.0 Request processed in 177us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.482698:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789607633.487077:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.487387:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789607633.487451:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789607633.487487:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789607633.487535:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789607633.487570:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789607633.487616:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789607633.487662:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789607633.487703:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789607633.490325:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789607633.490369:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789607633.490399:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789607633.490440:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789607633.490470:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789607633.490500:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789607633.490561:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789607633.490597:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789607633.490626:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789607633.490679:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789607633.492957:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789607633.493040:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789607633.493115:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789607633.493154:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789607633.493214:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789607633.493267:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789607633.493301:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789607633.493334:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789607633.493379:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789607633.493414:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789607633.493446:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789607633.493491:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789607633.493525:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789607633.493556:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789607633.493591:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789607633.493638:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789607633.493674:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789607633.493723:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789607633.493760:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789607633.493793:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789607633.493894:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789607633.493937:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789607633.493986:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789607633.494021:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789607633.494072:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789607633.494109:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789607633.494142:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789607633.494201:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789607633.494242:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789607633.494271:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789607633.494340:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607633.494417:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.494473:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607633.497359:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106624 00000100:00100000:3.0:1789607633.497372:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106624 00000100:00100000:3.0:1789607633.497429:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789607633.497439:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607633.497669:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106624:12345-0@lo:502:mount.lustre.0 Request processed in 231us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.497676:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789607633.499013:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.499191:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789607633.499238:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789607633.499278:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607633.499335:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.499377:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d92dc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607633.500015:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106752 00000100:00100000:3.0:1789607633.500023:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106752 00000100:00100000:3.0:1789607633.500068:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789607633.500076:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607633.500274:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150106752:12345-0@lo:502:mount.lustre.0 Request processed in 198us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.500281:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789607633.504064:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150106752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607633.504237:0:18460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789607633.504252:0:18460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789607633.510382:0:18470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789607633.510399:0:18470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d78e9ee8000) 00000020:00000080:0.0:1789607633.510422:0:18470:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1789607633.510499:0:18470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78fd000800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607633.510504:0:18470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78fd000800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607633.510506:0:18470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78fd000800 3 00010000:00080000:0.0:1789607633.510536:0:18470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78c635f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607633.521555:0:18470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789607633.523709:0:18470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789607633.523754:0:18470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789607633.523766:0:18470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa26202d240fbea93 00000100:00080000:1.0:1789607633.523776:0:18470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607633.523788:0:18470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78c635f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607633.523822:0:18470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd114e00 x1876539150106880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607633.523954:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150106880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789607633.524027:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789607633.524096:0:18470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789607633.526121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607633.526128:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607633.526131:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607633.526139:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:1.0:1789607633.526144:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789607633.526154:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607633.526175:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f075dc00 x1876539150107136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607633.526228:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607633.526251:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150107008:0@lo:400:kworker.0 00000100:00100000:0.0:1789607633.526316:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.526368:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107008 00000100:00100000:0.0:1789607633.526378:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107008 00000100:00100000:0.0:1789607633.526427:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607633.526438:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150107008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607633.526489:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150107008:12345-0@lo:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.526496:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607633.526535:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150107008:0@lo:400:kworker.0 00000100:00100000:2.0:1789607633.527544:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150107136:0@lo:8:kworker.0 00000100:00100000:2.0:1789607633.527591:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607633.529704:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107136 00000100:00100000:3.0:1789607633.529720:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107136 00000100:00100000:3.0:1789607633.529779:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607633.529788:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150107136:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789607633.529922:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150107136:12345-0@lo:8:kworker.0 Request processed in 134us (2329us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789607633.529930:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607633.530278:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607633.530286:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607633.530291:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789607633.530295:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150107136:0@lo:8:kworker.0 00000100:00100000:3.0:1789607633.532357:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150106880 00000100:00100000:3.0:1789607633.532370:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150106880 00000100:00100000:3.0:1789607633.532415:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607633.532424:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3467:x1876539150106880:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789607633.532459:0:16429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1789607633.532493:0:16429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa26202d240fbea9a 00000004:00100000:3.0:1789607633.532508:0:16429:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607633.532539:0:16429:0:(import.c:65:import_set_state_nolock()) ffff8d77c5f26800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607633.532620:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3467:x1876539150106880:12345-0@lo:38:llog_process_th.0 Request processed in 195us (8592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607633.532628:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1789607633.533133:0:18470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789607633.533149:0:18470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d78e9eeb380) 00000020:00000080:0.0:1789607633.533170:0:18470:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789607633.533240:0:18470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78fd000800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607633.533244:0:18470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78fd000800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607633.533246:0:18470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78fd000800 3 00010000:00080000:0.0:1789607633.533287:0:18470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c10f4000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00080000:2.0:1789607633.534177:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd114e00 x1876539150106880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607633.534190:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607633.534200:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789607633.534209:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789607633.534214:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789607633.534218:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789607633.534225:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150106880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607633.535243:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150107264:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.535303:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607633.535353:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107264 00000100:00100000:1.0:1789607633.535367:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107264 00000100:00100000:1.0:1789607633.535408:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607633.535417:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150107264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.535464:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150107264:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.535470:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789607633.535505:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f075ea00 x1876539150107264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607633.535517:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150107264:0@lo:400:kworker.0 00000100:00080000:1.0:1789607633.535552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607633.535556:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607633.535559:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607633.535563:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:1.0:1789607633.535567:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789607633.535573:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78e0099000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607633.535582:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150107392:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.535609:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607633.535643:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107392 00000100:00100000:1.0:1789607633.535647:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107392 00000100:00100000:1.0:1789607633.535672:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607633.535679:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3468:x1876539150107392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.535711:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3468:x1876539150107392:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.535717:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607633.535742:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150107392:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.535777:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f075ea00 x1876539150107520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607633.535806:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150107648:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.535831:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607633.536098:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150107520:0@lo:8:kworker.0 00000100:00100000:3.0:1789607633.536128:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607633.536157:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107520 00000100:00100000:3.0:1789607633.536161:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107520 00000100:00100000:3.0:1789607633.536181:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607633.536186:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150107520:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789607633.536232:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150107520:12345-0@lo:8:kworker.0 Request processed in 44us (103us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789607633.536238:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607633.536262:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607633.536266:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607633.536269:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789607633.536272:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150107520:0@lo:8:kworker.0 00000100:00100000:1.0:1789607633.538124:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107648 00000100:00100000:1.0:1789607633.538137:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107648 00000100:00100000:1.0:1789607633.538185:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607633.538194:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150107648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538265:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150107648:12345-0@lo:400:kworker.0 Request processed in 73us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.538273:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789607633.538311:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f075c000 x1876539150107648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607633.538323:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150107648:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538374:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150107776:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538403:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607633.538433:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107776 00000100:00100000:1.0:1789607633.538437:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107776 00000100:00100000:1.0:1789607633.538457:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607633.538462:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150107776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538493:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150107776:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.538498:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789607633.538524:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f075c000 x1876539150107776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607633.538545:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150107776:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538576:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150107904:0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538599:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607633.538623:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150107904 00000100:00100000:1.0:1789607633.538627:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150107904 00000100:00100000:1.0:1789607633.538646:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607633.538651:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150107904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607633.538681:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150107904:12345-0@lo:400:kworker.0 Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.538686:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789607633.538710:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f075c000 x1876539150107904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607633.538720:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150107904:0@lo:400:kworker.0 00010000:00010000:0.0:1789607633.540641:0:18470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789607633.541489:0:18470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789607633.541525:0:18470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607633.541536:0:18470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa26202d240fbeaa8 00000100:00080000:0.0:1789607633.541547:0:18470:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607633.541557:0:18470:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d77c10f4000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607633.541587:0:18470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fcd83800 x1876539150108032/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607633.541618:0:18470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789607633.543654:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150108032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607633.543729:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.544396:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108032 00000100:00100000:0.0:1789607633.544415:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108032 00000100:00100000:0.0:1789607633.544462:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607633.544469:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150108032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607633.544497:0:16428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1789607633.544532:0:16428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa26202d240fbeaaf 00000004:00100000:0.0:1789607633.544545:0:16428:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607633.544582:0:16428:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607633.544647:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3467:x1876539150108032:12345-0@lo:38:llog_process_th.0 Request processed in 177us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.544653:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789607633.545925:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fcd83800 x1876539150108032/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607633.545940:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607633.545949:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789607633.545968:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789607633.545973:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789607633.545976:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789607633.545982:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150108032:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789607633.548690:0:18470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789607633.549945:0:18460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789607633.550003:0:18460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607633.550027:0:18460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.550040:0:18460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789607633.550089:0:18460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789607633.550096:0:18460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607633.550097:0:18460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607633.550098:0:18460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607633.550099:0:18460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607633.550101:0:18460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607633.550102:0:18460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607633.550104:0:18460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607633.550105:0:18460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607633.550110:0:18460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789607633.550112:0:18460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607633.550113:0:18460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607633.550114:0:18460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607633.550115:0:18460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607633.550116:0:18460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607633.550117:0:18460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607633.550118:0:18460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607633.550119:0:18460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607633.550120:0:18460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607633.550146:0:18460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789607633.550167:0:18460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150108160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607633.550247:0:18460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607633.550292:0:18460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607633.550558:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108160 00000100:00100000:0.0:1789607633.550567:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108160 00000100:00100000:0.0:1789607633.550624:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607633.550634:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:18460:x1876539150108160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607633.550667:0:16423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789607633.550684:0:16423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789607633.613529:0:16423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607633.613550:0:16423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789607633.613608:0:16444:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607633.613613:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607633.613634:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.613651:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe958 expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.613658:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe966 expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.613665:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.613719:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe966 expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.613732:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe966 expref: 24 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607633.613746:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150108288:0@lo:104: 00000100:00100000:2.0:1789607633.613818:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607633.613905:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe958 expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.613913:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe958 expref: 24 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607633.613922:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150108416:0@lo:104: 00000100:00100000:2.0:1789607633.613943:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607633.613960:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607633.614129:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108288 00000100:00100000:0.0:1789607633.614137:0:16413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108288 00000100:00100000:0.0:1789607633.614169:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108416 00000100:00100000:0.0:1789607633.614172:0:16413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108416 00000100:00100000:0.0:1789607633.614185:0:16413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607633.614193:0:16413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:16444:x1876539150108288:12345-0@lo:104: 00010000:00010000:0.0:1789607633.614205:0:16413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614265:0:16413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607633.614276:0:16413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:16444:x1876539150108288:12345-0@lo:104: Request processed in 84us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.614283:0:16413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607633.614300:0:16413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607633.614307:0:16413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150108416:12345-0@lo:104: 00010000:00010000:0.0:1789607633.614316:0:16413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614348:0:16413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789607633.614353:0:16413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:16444:x1876539150108416:12345-0@lo:104: Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.614359:0:16413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789607633.614377:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607633.614383:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614389:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607633.614394:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614402:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607633.614409:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607633.614415:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789607633.614442:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614458:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607633.614478:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614485:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185e00/0xa26202d240fbe966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe96d expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614498:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607633.614502:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614508:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607633.614512:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614518:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607633.614524:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607633.614530:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789607633.614542:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614548:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607633.614553:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614560:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571fc00/0xa26202d240fbe958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe95f expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.614580:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607633.614582:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607633.614584:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607633.614589:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607633.614601:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150108544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607633.614629:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.614652:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607633.614657:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150108672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607633.614674:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607633.614702:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108544 00000100:00100000:0.0:1789607633.614706:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108544 00010000:00010000:0.0:1789607633.614721:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe966 expref: 25 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607633.614739:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108672 00000100:00100000:0.0:1789607633.614742:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108672 00010000:00010000:0.0:1789607633.614975:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe958 expref: 26 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607633.614993:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607633.615000:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+26:3468:x1876539150108544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607633.615011:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607633.615016:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe966 expref: 26 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615027:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe966 expref: 26 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615052:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607633.615082:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+26:3468:x1876539150108544:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.615089:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607633.615102:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607633.615108:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+25:3468:x1876539150108672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607633.615115:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607633.615119:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe958 expref: 25 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615127:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe958 expref: 25 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615138:0:16414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615145:0:16414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607633.615157:0:16414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005664107s 00010000:00010000:0.0:1789607633.615161:0:16414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615168:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615176:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615199:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615205:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607633.615208:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615215:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615224:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607633.615232:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607633.615255:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+25:3468:x1876539150108672:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607633.615261:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607633.615300:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150108672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607633.615309:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150108544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607633.616363:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580800/0xa26202d240fbe96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe966 expref: 24 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607633.616378:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ead80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150108288:0@lo:104: 00010000:00010000:2.0:1789607633.616388:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580a00/0xa26202d240fbe95f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe958 expref: 23 pid: 16424 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607633.616395:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4ebb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16444:1876539150108416:0@lo:104: 00010000:00010000:2.0:1789607633.616413:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.616435:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.616442:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607633.616448:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580400/0xa26202d240fbeab6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607633.631598:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:18460:x1876539150108160:12345-0@lo:253:mount.lustre.0 Request processed in 80958us (81343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607633.631613:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789607633.631732:0:18460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd4e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7095b5c7-e12e-406f-ad0b-bb55e8b45703:18460:1876539150108160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607633.631747:0:18460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789607633.631751:0:18460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607633.631762:0:18460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607633.631763:0:18460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607633.631764:0:18460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607633.631766:0:18460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607633.631767:0:18460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607633.631768:0:18460:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607633.631770:0:18460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607633.631771:0:18460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607633.631789:0:18460:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607633.645789:0:18460:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607633.646004:0:18460:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607633.646266:0:18460:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607633.646417:0:18460:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607633.646660:0:18460:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607633.646913:0:18460:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789607633.674528:0:18460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789607633.826567:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789607633.831300:0:18460:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789607633.831309:0:18460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789607633.831341:0:18460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789607633.831402:0:18460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789607633.831414:0:18460:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789607633.831442:0:18460:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789607634.850034:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789607635.242501:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789607635.242518:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 10000000:01000000:3.0:1789607635.618111:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607635.618271:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78d9435000 from 10 10000000:01000000:3.0:1789607635.618277:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607635.618328:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.618339:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.618350:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.618373:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150108800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607635.618438:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.619122:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.620810:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108800 00000100:00100000:0.0:1789607635.620824:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108800 00000100:00100000:0.0:1789607635.621116:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789607635.621127:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150108800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607635.621143:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607635.621161:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbeac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbeabd expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.621201:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbeac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbeabd expref: 23 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.621212:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbeac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbeabd expref: 23 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.621220:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075ca00, rc 0) 00000100:00100000:0.0:1789607635.621519:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150108800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 393us (3079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.621527:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789607635.621635:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150108800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607635.621655:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.621666:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.621741:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150108928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789607635.621781:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.621821:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607635.622917:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150108928 00000100:00100000:1.0:1789607635.622928:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150108928 00000100:00100000:1.0:1789607635.622979:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789607635.622989:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150108928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789607635.623021:0:16423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789607635.623038:0:16423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789607635.623041:0:16423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789607635.623139:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150108928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607635.623148:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789607635.623245:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150108928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789607635.623311:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607635.623321:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.623342:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607635.623353:0:16427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607635.623356:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c419c000 from 10 10000000:01000000:3.0:1789607635.623359:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607635.623385:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.623393:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.623402:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.623419:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150109056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607635.623451:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.623476:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.626132:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109056 00000100:00100000:0.0:1789607635.626147:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109056 00000100:00100000:0.0:1789607635.626219:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789607635.626229:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150109056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607635.626245:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607635.626263:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d000/0xa26202d240fbead2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbeacb expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.626289:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d000/0xa26202d240fbead2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbeacb expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.626299:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d000/0xa26202d240fbead2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbeacb expref: 24 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.626308:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d000, rc 0) 00000100:00100000:0.0:1789607635.626386:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150109056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.626410:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789607635.626984:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150109056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607635.627031:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.627047:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.627148:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150109184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789607635.627348:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.627424:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.627828:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109184 00000100:00100000:0.0:1789607635.627838:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109184 00000100:00100000:0.0:1789607635.627913:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607635.627922:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150109184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789607635.627945:0:16423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789607635.627964:0:16423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789607635.627967:0:16423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789607635.628097:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150109184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 175us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.628107:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789607635.628398:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfface00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150109184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789607635.628477:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607635.628487:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.628498:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.875276:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607636.898783:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607637.219164:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150109312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607637.219228:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607637.219286:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109312 00000100:00100000:0.0:1789607637.219293:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109312 00000100:00100000:0.0:1789607637.219349:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607637.219359:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150109312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607637.219393:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607637.219436:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150109312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607637.219443:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789607637.219461:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607637.219507:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150109312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607637.219733:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607637.219742:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150109440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607637.219769:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607637.219791:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109440 00000100:00100000:3.0:1789607637.219794:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109440 00000100:00100000:3.0:1789607637.219818:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607637.219824:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150109440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607637.219834:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607637.219887:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150109440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607637.219893:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789607637.219908:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607637.219921:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789607637.219936:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150109440:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789607637.926129:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607638.242151:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150109568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607638.242248:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607638.242723:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109568 00000100:00100000:3.0:1789607638.242735:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109568 00000100:00100000:3.0:1789607638.242801:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607638.242812:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150109568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607638.242897:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607638.242960:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150109568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607638.242967:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607638.243082:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150109568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607638.246763:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150109696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607638.246886:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607638.247115:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109696 00000100:00100000:0.0:1789607638.247124:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109696 00000100:00100000:0.0:1789607638.247189:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607638.247201:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150109696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607638.247250:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607638.247324:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150109696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.247333:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607638.247650:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150109696:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789607638.310101:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789607638.754288:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607638.754296:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607638.754300:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607638.754321:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78f567f000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607638.754347:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f075ce00 x1876539150110080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607638.761631:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150109952:0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.762257:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607638.762477:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607638.762489:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150109824:0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.762533:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607638.762758:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109824 00000100:00100000:0.0:1789607638.762769:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109824 00000100:00100000:0.0:1789607638.762833:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607638.762886:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.762951:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150109824:12345-0@lo:400:kworker.0 Request processed in 109us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.762960:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607638.762998:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150109952 00000100:00100000:0.0:1789607638.763002:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150109952 00000100:00100000:0.0:1789607638.763033:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607638.763041:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.763076:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150109952:12345-0@lo:400:kworker.0 Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.763114:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607638.763173:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150109824:0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.763190:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150109952:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.769454:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607638.769485:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150110208:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.769576:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607638.769633:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110208 00000100:00100000:1.0:1789607638.769642:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110208 00000100:00100000:1.0:1789607638.769704:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607638.769713:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150110208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.769774:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150110208:12345-0@lo:400:kworker.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607638.769782:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789607638.769843:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075e300 x1876539150110208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607638.769885:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150110208:0@lo:400:kworker.0 00000100:00080000:1.0:1789607638.769954:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607638.769959:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607638.769963:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607638.769974:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78e0099000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607638.769983:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150110336:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.770013:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607638.770060:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78f075ed80 x1876539150110464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607638.770200:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150110080:0@lo:8:kworker.0 00000100:00100000:2.0:1789607638.770239:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.770259:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150110464:0@lo:8:kworker.0 00000100:00100000:2.0:1789607638.770283:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.770314:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110336 00000100:00100000:2.0:1789607638.770319:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110336 00000100:00100000:2.0:1789607638.770350:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110080 00000100:00100000:2.0:1789607638.770353:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110080 00000100:00100000:2.0:1789607638.770363:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110464 00000100:00100000:2.0:1789607638.770366:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110464 00000100:00100000:2.0:1789607638.770377:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607638.770385:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150110336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607638.770425:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150110336:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607638.770440:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607638.770454:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607638.770459:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150110080:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789607638.770492:0:17737:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1789607638.770526:0:17737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbead9 00002000:00100000:2.0:1789607638.770543:0:17737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d77c10ae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789607638.770548:0:17737:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789607638.770552:0:17737:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789607638.771006:0:17737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789607638.771035:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d77c10af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607638.771083:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539150110080:12345-0@lo:8:kworker.0 Request processed in 622us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607638.771561:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607638.771588:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607638.771594:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150110464:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789607638.771621:0:17737:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1789607638.771645:0:17737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbeae0 00002000:00100000:2.0:1789607638.771656:0:17737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d77c10ab000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789607638.771660:0:17737:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789607638.771663:0:17737:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789607638.771720:0:17737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789607638.771736:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d77c10ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607638.771779:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539150110464:12345-0@lo:8:kworker.0 Request processed in 183us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607638.771785:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607638.771900:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150110336:0@lo:400:kworker.0 00010000:00080000:2.0:1789607638.771947:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075ce00 x1876539150110080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789607638.771962:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789607638.771970:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789607638.771976:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789607638.771979:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789607638.772001:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789607638.772006:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150110080:0@lo:8:kworker.0 00010000:00080000:2.0:1789607638.772020:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075ed80 x1876539150110464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789607638.772030:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789607638.772034:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789607638.772037:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789607638.772039:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789607638.772053:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789607638.772057:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150110464:0@lo:8:kworker.0 00000100:00100000:1.0:1789607638.772387:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150110592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.772434:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607638.772550:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f075c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150110720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.772577:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789607638.772617:0:16455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789607638.772637:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16455:1876539150110976:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789607638.772662:0:16455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.772679:0:16455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868f00 going to sleep for 11 seconds 00000004:00080000:2.0:1789607638.772699:0:16454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789607638.773404:0:16454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 543730540215ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789607638.773477:0:17074:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789607638.773497:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17074:1876539150111232:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789607638.773546:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.773570:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868480 going to sleep for 11 seconds 00000004:00080000:2.0:1789607638.773590:0:17072:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789607638.773975:0:17072:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 543731112916ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789607638.774005:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150110848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607638.774041:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.774069:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607638.774074:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150111104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607638.780283:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.780407:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110976 00000100:00100000:2.0:1789607638.780418:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110976 00000100:00100000:2.0:1789607638.780487:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111232 00000100:00100000:2.0:1789607638.780491:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111232 00000100:00100000:2.0:1789607638.780517:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607638.780529:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:16455:x1876539150110976:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789607638.783142:0:17737:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789607638.783156:0:17737:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789607638.783162:0:17737:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:0.0:1789607638.784898:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150111360:0@lo:400:kworker.0 00000100:00080000:0.0:1789607638.785015:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607638.785045:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110848 00000100:00100000:0.0:1789607638.785055:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110848 00000100:00100000:0.0:1789607638.785101:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111104 00000100:00100000:0.0:1789607638.785104:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111104 00000100:00100000:0.0:1789607638.785123:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607638.785133:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150110848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607638.785179:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607638.785248:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3468:x1876539150110848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (11205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.785255:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607638.785274:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607638.785280:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3468:x1876539150111104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607638.785290:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607638.785315:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3468:x1876539150111104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (5054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.785320:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607638.785707:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607638.785718:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17074:x1876539150111232:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789607638.791212:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110592 00000100:00100000:3.0:1789607638.791231:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110592 00000100:00100000:3.0:1789607638.791478:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150110720 00000100:00100000:3.0:1789607638.791483:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150110720 00000100:00100000:3.0:1789607638.791528:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607638.791554:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150110592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607638.791675:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150110592:12345-0@lo:400:kworker.0 Request processed in 124us (19239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607638.791683:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607638.791703:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607638.791710:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150110720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607638.791743:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150110720:12345-0@lo:400:kworker.0 Request processed in 34us (19165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607638.791749:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607638.794494:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789607638.794604:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075df80 x1876539150110592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607638.794624:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150110592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.794654:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607638.794664:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150111488:0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.794734:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607638.794946:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111360 00000100:00100000:1.0:1789607638.794955:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111360 00000100:00100000:1.0:1789607638.795002:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111488 00000100:00100000:1.0:1789607638.795005:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111488 00000100:00100000:1.0:1789607638.795029:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607638.795039:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.795427:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150111360:12345-0@lo:400:kworker.0 Request processed in 388us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607638.795435:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607638.795456:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607638.795463:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150111488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.795492:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150111488:12345-0@lo:400:kworker.0 Request processed in 30us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607638.795498:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789607638.805855:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80a80 x1876539150111488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607638.805900:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150111488:0@lo:400:kworker.0 00010000:00080000:1.0:1789607638.805920:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd81500 x1876539150111360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607638.805929:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150111360:0@lo:400:kworker.0 00002000:00080000:0.0:1789607638.812768:0:17740:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789607638.812792:0:17740:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789607638.812958:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17074:x1876539150111232:12345-0@lo:7:osp-pre-1-1.0 Request processed in 27235us (39404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.812971:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789607638.813023:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607638.813031:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607638.813747:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f075c380 x1876539150110720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607638.813769:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f075c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150110720:0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.814038:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607638.814057:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150111616:0@lo:400:kworker.0 00000100:00100000:0.0:1789607638.815614:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789607638.815718:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7d880 x1876539150111104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607638.815766:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150111104:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789607638.815783:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7c380 x1876539150110848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607638.815798:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150110848:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789607638.815904:0:17074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7c700 x1876539150111232/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607654 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607638.815914:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17074:1876539150111232:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789607638.815928:0:17074:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789607638.815975:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17074:1876539150111744:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789607638.816010:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607638.816029:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607638.816471:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111616 00000100:00100000:1.0:1789607638.816481:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111616 00000100:00100000:1.0:1789607638.816555:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607638.816567:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150111616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607638.816637:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150111616:12345-0@lo:400:kworker.0 Request processed in 73us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607638.816644:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789607638.816685:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789607638.816711:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd82d80 x1876539150111616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607638.816721:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150111616:0@lo:400:kworker.0 00002000:00010000:2.0:1789607638.824025:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.824039:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.824058:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.824063:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.824070:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607638.824922:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111744 00000100:00100000:1.0:1789607638.824937:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111744 00000100:00100000:1.0:1789607638.825005:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607638.825017:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17074:x1876539150111744:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789607638.825056:0:17740:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00010000:00010000:2.0:1789607638.829264:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829548:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829557:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829685:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.829702:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.829709:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829718:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.829723:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829734:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829758:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829766:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.829789:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.829798:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.829800:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607638.832602:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17074:x1876539150111744:12345-0@lo:5:osp-pre-1-1.0 Request processed in 7576us (16579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607638.832619:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607638.832758:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17074:1876539150111744:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789607638.832779:0:17074:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789607638.832850:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17074:1876539150111872:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789607638.832923:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607638.832956:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3071a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607638.832978:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150111872 00000100:00100000:0.0:1789607638.832986:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150111872 00000100:00100000:0.0:1789607638.833029:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607638.833039:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17074:x1876539150111872:12345-0@lo:5:osp-pre-1-1.0 00002000:00010000:2.0:1789607638.833766:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.833778:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789607638.838029:0:17740:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:2.0:1789607638.845708:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.845730:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.845744:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845770:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845786:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845796:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845847:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.845894:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.845902:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845912:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.845917:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845944:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845966:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.845974:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeaee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.846002:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.846004:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.846006:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.846968:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.846977:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.846993:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.846996:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.847002:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847012:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847019:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847033:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847054:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.847067:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.847072:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847080:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.847084:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847918:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847938:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847946:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeaf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.847968:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.847970:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.847972:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.858450:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.858484:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858506:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.858512:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.858520:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858539:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858553:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858562:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858594:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.858619:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.858626:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858634:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.858640:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858651:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858679:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858688:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeafc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.858709:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.858711:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.858713:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.859359:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.859367:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859378:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.859381:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.859385:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859396:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859405:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859413:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859457:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.859470:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.859476:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859484:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.859500:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859510:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859522:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859529:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859545:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.859547:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.859549:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.859974:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.859981:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.859990:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.859998:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.860003:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860014:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860023:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860031:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860045:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.860055:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.860058:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860066:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.860070:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860078:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860089:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860107:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860123:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.860124:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.860126:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.860506:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.860514:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860523:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.860526:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.860531:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860541:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860549:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860557:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860571:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.860579:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.860588:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860596:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.860599:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860607:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860617:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860624:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.860637:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.860638:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.860639:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.868286:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.868307:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.868330:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.868335:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.868343:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.868377:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.868389:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.868397:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.869766:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.869802:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.869818:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.869841:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.869847:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.869876:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.869905:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.869913:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc0e4c9c/0xa26202d240fbeb18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.869964:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.869966:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.869968:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.870709:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.870718:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870733:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.870737:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.870744:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870758:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870768:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870777:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870801:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.870813:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.870818:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870853:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.870857:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870894:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870906:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870913:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059866c46/0xa26202d240fbeb1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.870929:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.870931:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.870932:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.871341:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.871347:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871357:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.871361:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.871365:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871375:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871390:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871397:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871410:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.871419:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.871422:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871428:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.871432:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871439:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871450:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871457:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f686f2c/0xa26202d240fbeb26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871469:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.871477:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.871478:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.871934:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.871940:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871949:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.871952:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.871957:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871966:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871974:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871980:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.871993:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.872001:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.872005:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872011:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.872015:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872033:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872044:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872051:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872065:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.872066:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.872068:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.872468:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.872474:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872482:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.872486:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.872490:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872500:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872507:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872521:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872535:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.872544:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.872548:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872554:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.872557:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872566:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872577:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872585:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.872598:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.872599:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.872601:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.884895:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.884923:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.884947:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.884952:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.884959:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.884975:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.884987:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.884995:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885022:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607638.885544:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.885551:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885560:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.885564:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.885568:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885579:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885595:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885602:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885622:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789607638.885642:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607638.885649:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885658:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.885664:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885688:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885709:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885718:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000737aa8f7/0xa26202d240fbeb3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885749:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.885758:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885766:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.885771:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885780:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885791:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.885799:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001759cb20/0xa26202d240fbeb42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607638.887525:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.909629:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.909640:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.909643:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.912976:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.912993:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913015:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.913020:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.913027:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913057:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913069:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913078:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913106:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.913124:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.913132:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913142:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.913147:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913158:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913177:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913185:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c8f47e9/0xa26202d240fbeb49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.913215:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.913218:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.913220:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.915311:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.915324:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.915342:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.915347:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.915354:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.915370:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.915381:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.915389:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.915417:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.916578:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.916593:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.916625:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.916631:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.916643:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.916666:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.916789:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a7a0107/0xa26202d240fbeb50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.916912:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.916915:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.916917:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.918225:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.918234:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.918250:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.918254:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.918261:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.918275:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.918290:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.918297:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.919559:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.919591:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.919601:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.919615:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.919621:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.919633:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.919657:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.919665:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb928066/0xa26202d240fbeb57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.919902:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.919920:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.919922:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.922663:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.922691:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.922714:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.922719:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.922802:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.922920:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.922933:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.922943:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.922966:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.922982:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.922989:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.922998:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0031000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.923004:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.923028:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.923049:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.923058:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000722cad5/0xa26202d240fbeb5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.923080:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.923082:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.923084:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.925066:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.925082:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925101:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.925106:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.925112:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925126:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925136:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925151:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925173:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.925187:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.925194:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925202:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.925206:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925216:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925234:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925242:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000056699be/0xa26202d240fbeb65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.925262:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.925265:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.925266:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.927243:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.927261:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927281:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.927285:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.927291:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927305:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927315:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927322:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927345:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.927365:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.927371:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927378:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.927382:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927391:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927416:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927424:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9b25a7/0xa26202d240fbeb6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.927457:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.927460:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.927462:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.929649:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.929664:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929692:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.929697:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.929704:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929721:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929741:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929749:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929790:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.929928:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.929935:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929945:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.929950:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929959:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929979:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.929987:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000105f3e25/0xa26202d240fbeb73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930010:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.930012:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.930014:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.930545:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.930552:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930562:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.930572:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.930576:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930587:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930596:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930604:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930624:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.930635:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.930640:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930647:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.930651:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930661:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930674:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930695:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f5a66a7/0xa26202d240fbeb7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.930710:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.930711:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.930714:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.933328:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.933344:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933365:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.933370:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.933377:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933395:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933408:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933417:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933523:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.933548:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.933567:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933576:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.933581:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933592:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933613:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933621:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbeb81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.933651:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.933653:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.933655:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.936319:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.936335:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936356:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.936360:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.936367:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936399:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936413:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936423:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936467:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.936490:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.936499:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936507:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.936512:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936522:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936540:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936547:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f426765/0xa26202d240fbeb88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.936580:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.936582:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.936583:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.940298:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.940317:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940338:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.940344:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.940352:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940369:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940381:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940389:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940409:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.940425:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.940432:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940452:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.940458:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940468:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940486:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940494:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025e9ac07/0xa26202d240fbeb8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.940518:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.940520:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.940522:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.944083:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.944100:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944121:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.944127:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.944134:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944152:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944170:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944178:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944198:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.944213:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.944219:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944228:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.944233:0:16418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944242:0:16418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944262:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944270:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008577359d/0xa26202d240fbeb96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.944290:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.944297:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.944299:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607638.947234:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607638.947253:0:17737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947274:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1789607638.947280:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607638.947287:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947305:0:17737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947318:0:17737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947327:0:17737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947355:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607638.947378:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607638.947385:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947394:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607638.947400:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.947425:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.948572:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.948590:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87ccc7b/0xa26202d240fbeb9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607638.948620:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.948622:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607638.948625:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789607638.949272:0:17737:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1789607638.949406:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:16455:x1876539150110976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 168874us (176736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607638.949417:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607638.951290:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16455:1876539150110976:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789607638.951313:0:16455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789607638.951373:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16455:1876539150112000:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789607638.951552:0:16455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607638.951590:0:16455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607638.951615:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112000 00000100:00100000:2.0:1789607638.951622:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112000 00000100:00100000:1.0:1789607638.952468:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607638.952590:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:16455:x1876539150112000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789607638.952650:0:17739:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1789607638.959431:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789607638.975074:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789607638.981745:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:16455:x1876539150112000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 29255us (30183us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789607638.981761:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607638.982938:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16455:1876539150112000:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789607638.982974:0:16455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000004:00080000:2.0:1789607639.001107:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789607639.025393:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:17074:x1876539150111872:12345-0@lo:5:osp-pre-1-1.0 Request processed in 192342us (192456us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789607639.025411:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607639.033249:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17074:1876539150111872:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789607639.033276:0:17074:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789607639.033511:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17074:1876539150112128:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789607639.033595:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607639.033663:0:16439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112128 00000100:00100000:2.0:1789607639.033671:0:16439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112128 00000100:00100000:2.0:1789607639.035785:0:16439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607639.035812:0:16439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17074:x1876539150112128:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789607639.035951:0:16439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17074:x1876539150112128:12345-0@lo:900:osp-pre-1-1.0 Request processed in 152us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607639.035960:0:16439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607639.039125:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868f00 going to sleep for 11 seconds 00010000:00080000:3.0:1789607639.039189:0:17074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cfc7ed80 x1876539150112128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607655 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607639.039210:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17074:1876539150112128:0@lo:900:osp-pre-1-1.0 00000040:00080000:3.0:1789607639.143393:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1789607639.511254:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:1.0:1789607639.511279:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789607639.511340:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789607639.511346:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789607639.970143:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607640.996963:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607641.776839:0:18819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789607642.024598:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607642.339646:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150112256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607642.339715:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607642.339783:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112256 00000100:00100000:0.0:1789607642.339790:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112256 00000100:00100000:0.0:1789607642.339853:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607642.339882:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150112256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607642.339926:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607642.339970:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150112256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607642.339976:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789607642.339998:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607642.340033:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150112256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607642.340708:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150112384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607642.340748:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607642.341034:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112384 00000100:00100000:2.0:1789607642.341040:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112384 00000100:00100000:2.0:1789607642.341087:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607642.341095:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150112384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607642.341113:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789607642.342565:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607642.349027:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150112384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7924us (8269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607642.349041:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607642.349195:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150112384:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789607643.043952:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607643.363146:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607643.363170:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150112512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607643.363234:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607643.363338:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112512 00000100:00100000:1.0:1789607643.363346:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112512 00000100:00100000:1.0:1789607643.363391:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607643.363400:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150112512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607643.363436:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607643.363478:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150112512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.363484:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607643.363525:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150112512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607643.364256:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607643.364267:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150112640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607643.364300:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.364336:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112640 00000100:00100000:0.0:1789607643.364340:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112640 00000100:00100000:0.0:1789607643.364367:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789607643.364374:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150112640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607643.364396:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607643.364427:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150112640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.364433:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789607643.364457:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150112640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607643.875035:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150112768:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.875102:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.875135:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150113280:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.875160:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.876704:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150113792:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.876751:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.876785:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150114304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607643.876818:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.876840:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789607643.876847:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150113152:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.876886:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.876903:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150113664:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.876940:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.876959:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150114176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607643.876978:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.877017:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150112896:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.877040:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607643.877430:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112768 00000100:00100000:1.0:1789607643.877438:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112768 00000100:00100000:1.0:1789607643.877496:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607643.877506:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3469:x1876539150112768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.877565:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3469:x1876539150112768:12345-0@lo:400:kworker.0 Request processed in 60us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.877572:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607643.877603:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113792 00000100:00100000:1.0:1789607643.877607:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113792 00000100:00100000:1.0:1789607643.877640:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113152 00000100:00100000:1.0:1789607643.877642:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113152 00000100:00100000:1.0:1789607643.877654:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113664 00000100:00100000:1.0:1789607643.877656:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113664 00000100:00100000:1.0:1789607643.877670:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607643.877677:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.877708:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150113792:12345-0@lo:400:kworker.0 Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.877714:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607643.877726:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607643.877741:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150113152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.877768:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150113152:12345-0@lo:400:kworker.0 Request processed in 29us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.877774:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607643.877796:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607643.877802:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.877827:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150113664:12345-0@lo:400:kworker.0 Request processed in 26us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.877833:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789607643.877848:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607643.877852:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789607643.877901:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a54e00 x1876539150113152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607643.877914:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150113152:0@lo:400:kworker.0 00010000:00080000:1.0:1789607643.877925:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55f80 x1876539150113664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607643.877933:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150113664:0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.877943:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150112768:0@lo:400:kworker.0 00010000:00080000:1.0:1789607643.877953:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a57800 x1876539150113792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607643.877960:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150113792:0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.880949:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150113024:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.881284:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114304 00000100:00100000:0.0:1789607643.881293:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114304 00000100:00100000:0.0:1789607643.881337:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114176 00000100:00100000:0.0:1789607643.881340:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114176 00000100:00100000:0.0:1789607643.881360:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607643.881369:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150114304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607643.881403:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607643.881448:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150114304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.881454:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607643.881484:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607643.881491:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150114176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607643.881501:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607643.881525:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150114176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (4545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.881530:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789607643.881556:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607643.881569:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607643.884006:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113280 00000100:00100000:2.0:1789607643.884023:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113280 00000100:00100000:2.0:1789607643.884092:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150112896 00000100:00100000:2.0:1789607643.884107:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150112896 00000100:00100000:2.0:1789607643.884138:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607643.884148:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607643.884233:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150113280:12345-0@lo:400:kworker.0 Request processed in 86us (9070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607643.884240:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607643.884256:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607643.884263:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150112896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607643.884292:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150112896:12345-0@lo:400:kworker.0 Request processed in 29us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607643.884297:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607643.884517:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150113536:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.884555:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.884580:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150114048:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.884612:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.884655:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113536 00000100:00100000:0.0:1789607643.884659:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113536 00000100:00100000:0.0:1789607643.884686:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114048 00000100:00100000:0.0:1789607643.884689:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114048 00000100:00100000:0.0:1789607643.884722:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607643.884730:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150113536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.884765:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150113536:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.884770:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607643.884782:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607643.884805:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150114048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.884834:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150114048:12345-0@lo:400:kworker.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.884839:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789607643.884857:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789607643.884965:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55c00 x1876539150113536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607643.884979:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150113536:0@lo:400:kworker.0 00010000:00080000:0.0:1789607643.884990:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a55180 x1876539150114048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607643.884998:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150114048:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885032:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789607643.885199:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150114176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607643.885213:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789607643.885244:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150114304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607643.885260:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150113280:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885300:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150112896:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885307:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150113408:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885334:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.885354:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150113920:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885377:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607643.885550:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113024 00000100:00100000:0.0:1789607643.885555:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113024 00000100:00100000:0.0:1789607643.885574:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113408 00000100:00100000:0.0:1789607643.885576:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113408 00000100:00100000:0.0:1789607643.885590:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607643.885595:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150113024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885633:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150113024:12345-0@lo:400:kworker.0 Request processed in 37us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.885638:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607643.885650:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607643.885656:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150113408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885684:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150113408:12345-0@lo:400:kworker.0 Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.885689:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607643.885719:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150113024:0@lo:400:kworker.0 00000100:00100000:0.0:1789607643.885738:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150113408:0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.885804:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150113920 00000100:00100000:1.0:1789607643.885814:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150113920 00000100:00100000:1.0:1789607643.885922:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607643.885930:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607643.885974:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150113920:12345-0@lo:400:kworker.0 Request processed in 45us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.885981:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789607643.886033:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607643.886060:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900a57b80 x1876539150113920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607643.886071:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150113920:0@lo:400:kworker.0 00000100:00100000:3.0:1789607643.907007:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607643.907638:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102528 00000100:00100000:0.0:1789607643.907649:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102528 00000100:00100000:0.0:1789607643.907694:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:0.0:1789607643.907703:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1876539130102528:12345-192.168.203.25@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789607643.907730:0:16423:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0558d189-bcbe-419b-abe6-53549136797c@192.168.203.25@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1789607643.907761:0:16423:0:(genops.c:1384:class_connect()) connect: client 0558d189-bcbe-419b-abe6-53549136797c, cookie 0xa26202d240fbeba4 00000100:00080000:0.0:1789607643.908113:0:16423:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607643.908184:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+5:2392:x1876539130102528:12345-192.168.203.25@tcp:250:mount.lustre.0 Request processed in 480us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.908193:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:1.0:1789607643.930727:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607643.930825:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102656 00000100:00100000:0.0:1789607643.930834:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102656 00000100:00100000:0.0:1789607643.930917:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:0.0:1789607643.930927:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+5:15007:x1876539130102656:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607643.930945:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607643.930963:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbebab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c5f expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607643.930992:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbebab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c5f expref: 6 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607643.931003:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbebab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c5f expref: 6 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607643.931029:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075cc00, rc 0) 00000100:00100000:0.0:1789607643.931087:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+6:15007:x1876539130102656:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 161us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.931093:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:3.0:1789607643.933714:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607643.933820:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102784 00000100:00100000:0.0:1789607643.933829:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102784 00000100:00100000:0.0:1789607643.933961:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:0.0:1789607643.933971:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+6:15007:x1876539130102784:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607643.934316:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+6:15007:x1876539130102784:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 346us (612us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607643.934324:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:3.0:1789607643.939746:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607643.939837:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130102912 00000100:00100000:1.0:1789607643.939847:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130102912 00000100:00100000:1.0:1789607643.939928:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:1.0:1789607643.939938:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+6:15007:x1876539130102912:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607643.939955:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607643.939971:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf76e00/0xa26202d240fbebb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c66 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607643.939998:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf76e00/0xa26202d240fbebb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c66 expref: 7 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607643.940008:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf76e00/0xa26202d240fbebb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c66 expref: 7 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607643.940016:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76e00, rc 0) 00000100:00100000:1.0:1789607643.940072:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+7:15007:x1876539130102912:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.940078:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:1.0:1789607643.942590:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607643.944201:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103040 00000100:00100000:0.0:1789607643.944217:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103040 00000100:00100000:0.0:1789607643.944282:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:0.0:1789607643.944292:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+7:15007:x1876539130103040:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607643.944584:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+8:15007:x1876539130103040:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 292us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607643.944592:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:3.0:1789607643.947702:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607643.947797:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103168 00000100:00100000:2.0:1789607643.947806:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103168 00000100:00100000:2.0:1789607643.947856:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:3.0:1789607643.948027:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+8:15007:x1876539130103168:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789607643.948396:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+8:15007:x1876539130103168:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 415us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607643.948413:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:3.0:1789607643.960116:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607643.960231:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103296 00000100:00100000:1.0:1789607643.960240:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103296 00000100:00100000:1.0:1789607643.960310:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:1.0:1789607643.960321:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+8:15026:x1876539130103296:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607643.960685:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+8:15026:x1876539130103296:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 365us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607643.960694:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:1.0:1789607644.013523:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607644.021007:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103424 00000100:00100000:3.0:1789607644.021020:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103424 00000100:00100000:2.0:1789607644.031910:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:2.0:1789607644.031923:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+8:15026:x1876539130103424:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607644.035887:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+8:15026:x1876539130103424:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 3938us (22346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607644.035900:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:3.0:1789607644.040260:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607644.040501:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103552 00000100:00100000:0.0:1789607644.040512:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103552 00000100:00100000:0.0:1789607644.040570:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:0.0:1789607644.040581:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+8:15026:x1876539130103552:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607644.040886:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+8:15026:x1876539130103552:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 279us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607644.040906:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:3.0:1789607644.058046:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607644.060927:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103680 00000100:00100000:2.0:1789607644.060952:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103680 00000100:00100000:2.0:1789607644.061024:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:2.0:1789607644.061035:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+8:15007:x1876539130103680:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789607644.061051:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607644.061069:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd580600/0xa26202d240fbebb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c97 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607644.061115:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd580600/0xa26202d240fbebb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c97 expref: 9 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607644.061125:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd580600/0xa26202d240fbebb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c97 expref: 9 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607644.061135:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580600, rc 0) 00000100:00100000:2.0:1789607644.061195:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+9:15007:x1876539130103680:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 162us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607644.061201:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00010000:00010000:2.0:1789607644.070469:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607644.077476:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607644.077572:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103808 00000100:00100000:1.0:1789607644.077583:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103808 00000100:00100000:1.0:1789607644.077638:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:1.0:1789607644.077649:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+9:15007:x1876539130103808:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789607644.077674:0:16424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789607644.077698:0:16424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789607644.077702:0:16424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789607644.077705:0:16424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789607644.077708:0:16424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789607644.077710:0:16424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789607644.079397:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+9:15007:x1876539130103808:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 1742us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607644.079409:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:3.0:1789607644.082267:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607644.082471:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130103936 00000100:00100000:0.0:1789607644.082481:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130103936 00000100:00100000:0.0:1789607644.082533:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:0.0:1789607644.082542:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+9:15007:x1876539130103936:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607644.082558:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607644.082575:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668c9e expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607644.082602:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 10 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607644.082614:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 10 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607644.082623:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c000, rc 0) 00000100:00100000:0.0:1789607644.082674:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+10:15007:x1876539130103936:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 132us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607644.082680:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:2.0:1789607644.087473:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607644.089902:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104064 00000100:00100000:1.0:1789607644.089916:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104064 00000100:00100000:1.0:1789607644.089986:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:1.0:1789607644.089996:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+10:15007:x1876539130104064:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789607644.090278:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+10:15007:x1876539130104064:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 283us (2814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607644.090286:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:3.0:1789607644.092667:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607644.092742:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104192 00000100:00100000:2.0:1789607644.092751:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104192 00000100:00100000:2.0:1789607644.092820:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:2.0:1789607644.092831:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+10:15007:x1876539130104192:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789607644.093155:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+10:15007:x1876539130104192:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 325us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607644.093163:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:3.0:1789607644.096248:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607644.096340:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104320 00000100:00100000:0.0:1789607644.096350:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104320 00000100:00100000:0.0:1789607644.096402:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:0.0:1789607644.096413:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+10:15031:x1876539130104320:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607644.096695:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+10:15031:x1876539130104320:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 283us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607644.096703:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:3.0:1789607644.098687:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607644.098779:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104448 00000100:00100000:1.0:1789607644.098798:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104448 00000100:00100000:1.0:1789607644.098850:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:1.0:1789607644.098885:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f6188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+10:15031:x1876539130104448:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607644.099131:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f6188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+10:15031:x1876539130104448:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 272us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607644.099140:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:3.0:1789607644.118814:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607644.118949:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607644.119295:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104576 00000100:00100000:0.0:1789607644.119305:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104576 00000100:00100000:0.0:1789607644.119346:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104832 00000100:00100000:0.0:1789607644.119349:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104832 00000100:00100000:0.0:1789607644.119376:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1789607644.119384:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1876539130104576:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789607644.119414:0:16428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5229d179-f1d7-42df-bf19-19cb16e792a3@192.168.203.25@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1789607644.119462:0:16428:0:(genops.c:1384:class_connect()) connect: client 5229d179-f1d7-42df-bf19-19cb16e792a3, cookie 0xa26202d240fbebc7 00000004:00100000:0.0:1789607644.119491:0:16428:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789607644.119899:0:16428:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607644.120085:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:3.0:1789607644.120092:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876539130104832:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789607644.120111:0:16429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 5229d179-f1d7-42df-bf19-19cb16e792a3@192.168.203.25@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1789607644.120146:0:16429:0:(genops.c:1384:class_connect()) connect: client 5229d179-f1d7-42df-bf19-19cb16e792a3, cookie 0xa26202d240fbebce 00000004:00100000:3.0:1789607644.120162:0:16429:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789607644.120431:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2392:x1876539130104576:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 1045us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607644.120439:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00080000:3.0:1789607644.127281:0:16429:0:(import.c:65:import_set_state_nolock()) ffff8d77c5f22800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607644.127361:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2392:x1876539130104832:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 7264us (8407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607644.127372:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1789607644.131182:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607644.131222:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607644.132905:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105088 00000100:00100000:3.0:1789607644.132918:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105088 00000100:00100000:3.0:1789607644.132998:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104704 00000100:00100000:3.0:1789607644.133001:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104704 00000100:00100000:3.0:1789607644.133029:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1789607644.133039:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15007:x1876539130105088:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789607644.133092:0:16430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607644.133181:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15007:x1876539130105088:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 143us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607644.133189:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1789607644.133207:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:3.0:1789607644.133213:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:0:x1876539130104704:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789607644.133224:0:16430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607644.133246:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:0:x1876539130104704:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 33us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607644.133253:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00080000:1.0:1789607644.133644:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607644.137187:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607644.137269:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105216 00000100:00100000:3.0:1789607644.137280:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105216 00000100:00100000:3.0:1789607644.137343:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1789607644.137354:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15007:x1876539130105216:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789607644.137485:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15007:x1876539130105216:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607644.137492:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:1.0:1789607644.148456:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607644.151882:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130104960 00000100:00100000:2.0:1789607644.151898:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130104960 00000100:00100000:2.0:1789607644.151982:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1789607644.151997:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+6:0:x1876539130104960:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789607644.152037:0:17627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607644.152135:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+6:0:x1876539130104960:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 144us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607644.152143:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00080000:1.0:1789607644.152875:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607644.164309:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607644.164359:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607644.164465:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105344 00000100:00100000:0.0:1789607644.164474:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105344 00000100:00100000:0.0:1789607644.164520:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:0.0:1789607644.164529:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876539130105344:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789607644.164563:0:17739:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5229d179-f1d7-42df-bf19-19cb16e792a3@192.168.203.25@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1789607644.164612:0:17739:0:(genops.c:1384:class_connect()) connect: client 5229d179-f1d7-42df-bf19-19cb16e792a3, cookie 0xa26202d240fbebd5 00002000:00100000:0.0:1789607644.164623:0:17739:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5229d179-f1d7-42df-bf19-19cb16e792a3/ffff8d78f77bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607644.164646:0:17739:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607644.165007:0:17739:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607644.165033:0:17739:0:(import.c:65:import_set_state_nolock()) ffff8d78f77bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607644.165088:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2392:x1876539130105344:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 559us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607644.165104:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607644.165282:0:16440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105600 00000100:00100000:1.0:1789607644.165288:0:16440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105600 00000100:00100000:1.0:1789607644.165328:0:16440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:1.0:1789607644.165336:0:16440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15007:x1876539130105600:12345-192.168.203.25@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789607644.165372:0:16440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15007:x1876539130105600:12345-192.168.203.25@tcp:900:mount.lustre.0 Request processed in 37us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607644.165379:0:16440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607644.170011:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607644.170103:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607644.170197:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105472 00000100:00100000:2.0:1789607644.170207:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105472 00000100:00100000:2.0:1789607644.170257:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1789607644.170265:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876539130105472:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789607644.170299:0:17881:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5229d179-f1d7-42df-bf19-19cb16e792a3@192.168.203.25@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:2.0:1789607644.170330:0:17881:0:(genops.c:1384:class_connect()) connect: client 5229d179-f1d7-42df-bf19-19cb16e792a3, cookie 0xa26202d240fbebdc 00002000:00100000:2.0:1789607644.170341:0:17881:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5229d179-f1d7-42df-bf19-19cb16e792a3/ffff8d77c10a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607644.170350:0:17881:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607644.170660:0:17881:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789607644.170689:0:17881:0:(import.c:65:import_set_state_nolock()) ffff8d77c10aa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607644.170759:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2392:x1876539130105472:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 493us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607644.170767:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1789607644.170928:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105728 00000100:00100000:3.0:1789607644.170933:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105728 00000100:00100000:3.0:1789607644.170969:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:3.0:1789607644.170977:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15007:x1876539130105728:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789607644.175922:0:16431:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4892us 00000004:00200000:2.0:1789607644.198779:0:16431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607644.198945:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15007:x1876539130105728:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 27962us (28835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607644.198959:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1789607644.365555:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607644.365641:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105856 00000100:00100000:3.0:1789607644.365661:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105856 00000100:00100000:3.0:1789607644.365722:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1789607644.365733:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15054:x1876539130105856:12345-192.168.203.25@tcp:101:mkdir.0 00010000:00010000:3.0:1789607644.365752:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607644.365777:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fa00/0xa26202d240fbebe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ccf expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607644.365849:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbebea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607644.365887:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbebea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607644.365902:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbebea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607644.365948:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607644.365951:0:16430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607644.365988:0:16430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbebea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607644.366014:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fa00/0xa26202d240fbebe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ccf expref: 8 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607644.366033:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbebea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ccf expref: 7 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607644.366042:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:3.0:1789607644.366056:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607644.366060:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571fc00, rc 0) 00000100:00100000:3.0:1789607644.366165:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15054:x1876539130105856:12345-192.168.203.25@tcp:101:mkdir.0 Request processed in 434us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607644.366171:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000001:00100000:3.0:1789607644.439283:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00010000:00010000:0.0:1789607645.090156:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607645.478279:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00010000:00010000:2.0:1789607646.114305:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607646.298642:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.304134:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130105984 00000100:00100000:2.0:1789607646.304152:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130105984 00000100:00100000:2.0:1789607646.304331:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1789607646.304348:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15106:x1876539130105984:12345-192.168.203.25@tcp:41:lfs.0 00000004:00000024:2.0:1789607646.304393:0:17627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607646.304522:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15106:x1876539130105984:12345-192.168.203.25@tcp:41:lfs.0 Request processed in 183us (6264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.304528:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00080000:1.0:1789607646.304753:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607646.306829:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607646.307339:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106112 00000100:00100000:3.0:1789607646.307349:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106112 00000100:00100000:3.0:1789607646.307473:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607646.307484:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15106:x1876539130106112:12345-192.168.203.25@tcp:41:lfs.0 00000004:00000024:3.0:1789607646.307534:0:16430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607646.307635:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15106:x1876539130106112:12345-192.168.203.25@tcp:41:lfs.0 Request processed in 152us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607646.307642:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00080000:0.0:1789607646.308479:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607646.312048:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.312125:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106240 00000100:00100000:0.0:1789607646.312135:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106240 00000100:00100000:0.0:1789607646.312257:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1789607646.312268:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15106:x1876539130106240:12345-192.168.203.25@tcp:13:lfs.0 00002000:00000024:0.0:1789607646.312303:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789607646.312328:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607646.312381:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15106:x1876539130106240:12345-192.168.203.25@tcp:13:lfs.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.312389:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:1.0:1789607646.314652:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.314810:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106368 00000100:00100000:0.0:1789607646.314820:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106368 00000100:00080000:1.0:1789607646.315074:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607646.315624:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1789607646.315638:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15106:x1876539130106368:12345-192.168.203.25@tcp:13:lfs.0 00002000:00000024:0.0:1789607646.315674:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607646.315775:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15106:x1876539130106368:12345-192.168.203.25@tcp:13:lfs.0 Request processed in 134us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.315783:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1789607646.447204:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.447476:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106496 00000100:00100000:2.0:1789607646.447486:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106496 00000100:00100000:2.0:1789607646.447554:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:2.0:1789607646.447565:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f618b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+10:15142:x1876539130106496:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789607646.447581:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607646.447599:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbebf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668cd6 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607646.447628:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbebf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668cd6 expref: 11 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607646.447641:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbebf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668cd6 expref: 11 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607646.447650:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581c00, rc 0) 00000100:00100000:2.0:1789607646.447704:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f618b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+11:15142:x1876539130106496:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 142us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.447710:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:3.0:1789607646.451952:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.452188:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106624 00000100:00100000:0.0:1789607646.452199:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106624 00000100:00100000:0.0:1789607646.452258:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:0.0:1789607646.452279:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+11:15142:x1876539130106624:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607646.452616:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+11:15142:x1876539130106624:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 346us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.452624:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:3.0:1789607646.455403:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.455561:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106752 00000100:00100000:1.0:1789607646.455570:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106752 00000100:00100000:0.0:1789607646.455678:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:0.0:1789607646.455691:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+11:15142:x1876539130106752:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789607646.456180:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+11:15142:x1876539130106752:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 490us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.456190:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:3.0:1789607646.459613:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.460412:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130106880 00000100:00100000:2.0:1789607646.460424:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130106880 00000100:00100000:2.0:1789607646.460491:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:2.0:1789607646.460503:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+11:15146:x1876539130106880:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607646.461641:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+11:15146:x1876539130106880:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 1136us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.461664:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:3.0:1789607646.476211:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.476312:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107008 00000100:00100000:1.0:1789607646.476323:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107008 00000100:00100000:1.0:1789607646.476382:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:1.0:1789607646.476392:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+11:15146:x1876539130107008:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607646.476678:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+11:15146:x1876539130107008:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 286us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.476686:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:3.0:1789607646.487746:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.488744:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107136 00000100:00100000:2.0:1789607646.488755:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107136 00000100:00100000:2.0:1789607646.488829:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:2.0:1789607646.488839:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+11:15146:x1876539130107136:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607646.489303:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+11:15146:x1876539130107136:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 464us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.489312:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:3.0:1789607646.495339:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.495488:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107264 00000100:00100000:0.0:1789607646.495498:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107264 00000100:00100000:0.0:1789607646.495563:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:0.0:1789607646.495575:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+11:15142:x1876539130107264:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607646.495591:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607646.495610:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075d200/0xa26202d240fbebf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d07 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607646.495638:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075d200/0xa26202d240fbebf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d07 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607646.495648:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075d200/0xa26202d240fbebf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d07 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607646.495656:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d200, rc 0) 00000100:00100000:0.0:1789607646.495714:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+12:15142:x1876539130107264:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 140us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.495720:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:3.0:1789607646.499824:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.501198:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107392 00000100:00100000:2.0:1789607646.501211:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107392 00000100:00100000:2.0:1789607646.501282:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 136 00000100:00100000:2.0:1789607646.501294:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+12:15142:x1876539130107392:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789607646.501319:0:16421:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789607646.501344:0:16421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789607646.501348:0:16421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789607646.501351:0:16421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789607646.501354:0:16421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789607646.501356:0:16421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789607646.507288:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+12:15142:x1876539130107392:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 5988us (7463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.507301:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 136 00000100:00100000:3.0:1789607646.510272:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.510724:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107520 00000100:00100000:1.0:1789607646.510734:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107520 00000100:00100000:1.0:1789607646.510927:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:1.0:1789607646.510939:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+12:15142:x1876539130107520:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607646.510955:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607646.510972:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d0e expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.511000:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 13 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.511011:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 13 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.511019:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77a00, rc 0) 00000100:00100000:1.0:1789607646.511079:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:15142:x1876539130107520:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 143us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.511086:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:3.0:1789607646.512945:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.513495:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107648 00000100:00100000:0.0:1789607646.513507:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107648 00000100:00100000:0.0:1789607646.513547:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:0.0:1789607646.513556:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15142:x1876539130107648:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607646.513890:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15142:x1876539130107648:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 334us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.513898:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:3.0:1789607646.515764:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.516117:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107776 00000100:00100000:0.0:1789607646.516126:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107776 00000100:00100000:0.0:1789607646.516164:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:0.0:1789607646.516173:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15142:x1876539130107776:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789607646.516445:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15142:x1876539130107776:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 271us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.516453:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:3.0:1789607646.519635:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.519848:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130107904 00000100:00100000:1.0:1789607646.519859:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130107904 00000100:00100000:1.0:1789607646.520040:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:1.0:1789607646.520063:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15149:x1876539130107904:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607646.520381:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15149:x1876539130107904:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 319us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.520390:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:0.0:1789607646.533717:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.533760:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108032 00000100:00100000:1.0:1789607646.533776:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108032 00000100:00100000:1.0:1789607646.533824:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:1.0:1789607646.533832:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15149:x1876539130108032:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607646.534030:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15149:x1876539130108032:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 199us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.534036:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:1.0:1789607646.548949:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.549017:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108160 00000100:00100000:2.0:1789607646.549027:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108160 00000100:00100000:2.0:1789607646.549072:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:2.0:1789607646.549081:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876539130108160:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789607646.549109:0:17627:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7995d486-89d1-4e60-a37c-33f943ccf6a0@192.168.203.25@tcp t0 exp 0000000000000000 cur 551 last 0 00000100:00100000:0.0:1789607646.549160:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000020:00000080:2.0:1789607646.549163:0:17627:0:(genops.c:1384:class_connect()) connect: client 7995d486-89d1-4e60-a37c-33f943ccf6a0, cookie 0xa26202d240fbec06 00000004:00100000:2.0:1789607646.549196:0:17627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789607646.549275:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108416 00000100:00100000:3.0:1789607646.549281:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108416 00000100:00080000:2.0:1789607646.549318:0:17627:0:(import.c:65:import_set_state_nolock()) ffff8d78fce64800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607646.549360:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:3.0:1789607646.549367:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1876539130108416:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789607646.549384:0:16430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7995d486-89d1-4e60-a37c-33f943ccf6a0@192.168.203.25@tcp t0 exp 0000000000000000 cur 551 last 0 00000100:00100000:2.0:1789607646.549398:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2392:x1876539130108160:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 314us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.549407:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000020:00000080:3.0:1789607646.549411:0:16430:0:(genops.c:1384:class_connect()) connect: client 7995d486-89d1-4e60-a37c-33f943ccf6a0, cookie 0xa26202d240fbec0d 00000004:00100000:3.0:1789607646.549428:0:16430:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789607646.549492:0:16430:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607646.549522:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2392:x1876539130108416:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 153us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607646.549530:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1789607646.553890:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.554085:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108288 00000100:00100000:1.0:1789607646.554095:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108288 00000100:00100000:1.0:1789607646.554170:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:1.0:1789607646.554181:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:0:x1876539130108288:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607646.554210:0:16428:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607646.554281:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:0:x1876539130108288:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 102us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.554290:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00080000:0.0:1789607646.554581:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607646.558722:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.559512:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108672 00000100:00100000:2.0:1789607646.559523:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108672 00000100:00100000:2.0:1789607646.559584:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1789607646.559595:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130108672:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789607646.559625:0:17627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607646.559700:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130108672:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 107us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.559708:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607646.562968:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.565046:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108544 00000100:00100000:1.0:1789607646.565059:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108544 00000100:00100000:1.0:1789607646.565149:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607646.565161:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2395:x1876539130108544:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607646.565204:0:16428:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607646.565289:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2395:x1876539130108544:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 130us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.565297:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00080000:0.0:1789607646.565954:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607646.566292:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607646.566598:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108800 00000100:00100000:0.0:1789607646.566605:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108800 00000100:00100000:0.0:1789607646.566644:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607646.566654:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130108800:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789607646.566715:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130108800:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 63us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607646.566722:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1789607646.569134:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607646.569169:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607646.569198:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.569211:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130108928 00000100:00100000:2.0:1789607646.569223:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130108928 00000100:00100000:2.0:1789607646.569251:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109056 00000100:00100000:2.0:1789607646.569253:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109056 00000100:00100000:2.0:1789607646.569269:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1789607646.569276:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130108928:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789607646.569313:0:17737:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7995d486-89d1-4e60-a37c-33f943ccf6a0@192.168.203.25@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1789607646.569334:0:17737:0:(genops.c:1384:class_connect()) connect: client 7995d486-89d1-4e60-a37c-33f943ccf6a0, cookie 0xa26202d240fbec14 00002000:00100000:2.0:1789607646.569343:0:17737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7995d486-89d1-4e60-a37c-33f943ccf6a0/ffff8d78fce63800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607646.569354:0:17737:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607646.569520:0:17737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789607646.569560:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d78fce63000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607646.569626:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2392:x1876539130108928:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 348us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.569634:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1789607646.569651:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1789607646.569655:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130109056:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789607646.569672:0:17737:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7995d486-89d1-4e60-a37c-33f943ccf6a0@192.168.203.25@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1789607646.569690:0:17737:0:(genops.c:1384:class_connect()) connect: client 7995d486-89d1-4e60-a37c-33f943ccf6a0, cookie 0xa26202d240fbec1b 00002000:00100000:2.0:1789607646.569695:0:17737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7995d486-89d1-4e60-a37c-33f943ccf6a0/ffff8d78fce62000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607646.569701:0:17737:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607646.569798:0:17737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789607646.569813:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d78fce65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607646.569837:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2392:x1876539130109056:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 181us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.569844:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1789607646.575165:0:16440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109184 00000100:00100000:1.0:1789607646.575180:0:16440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109184 00000100:00100000:1.0:1789607646.575260:0:16440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1789607646.575271:0:16440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130109184:12345-192.168.203.25@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789607646.575365:0:16440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130109184:12345-192.168.203.25@tcp:900:mount.lustre.0 Request processed in 96us (6166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.575373:0:16440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1789607646.583439:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607646.583530:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109312 00000100:00100000:2.0:1789607646.583540:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109312 00000100:00100000:2.0:1789607646.583595:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:2.0:1789607646.583606:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130109312:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789607646.583677:0:16432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607646.583763:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15142:x1876539130109312:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607646.583782:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1789607646.711140:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607646.711255:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109440 00000100:00100000:1.0:1789607646.711265:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109440 00000100:00100000:1.0:1789607646.711332:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:1.0:1789607646.711343:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15172:x1876539130109440:12345-192.168.203.25@tcp:101:mkdir.0 00010000:00010000:1.0:1789607646.711362:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607646.711385:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77600/0xa26202d240fbec22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d3f expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.711448:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.711461:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.711474:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607646.711526:0:16428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607646.711530:0:16428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607646.711551:0:16428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.711576:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77600/0xa26202d240fbec22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 8 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.711592:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 7 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.711599:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:1.0:1789607646.711602:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607646.711606:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77800, rc 0) 00000100:00100000:1.0:1789607646.711665:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+7:15172:x1876539130109440:12345-192.168.203.25@tcp:101:mkdir.0 Request processed in 324us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607646.711673:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00010000:00010000:0.0:1789607647.140523:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607647.462915:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150114432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607647.463168:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607647.463805:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150114560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607647.463877:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607647.463917:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114432 00000100:00100000:2.0:1789607647.463919:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114560 00000100:00100000:2.0:1789607647.463926:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114560 00000100:00100000:0.0:1789607647.463926:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114432 00000100:00100000:0.0:1789607647.463987:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607647.463996:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150114432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607647.464017:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789607647.464051:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607647.464078:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150114432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607647.464086:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607647.464106:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607647.464114:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150114560:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607647.464123:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150114432:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607647.464125:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607647.464163:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150114560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607647.464170:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607647.464198:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150114560:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789607648.162041:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607648.482384:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607648.482420:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150114816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607648.482520:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607648.482597:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150114688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607648.482618:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607648.482661:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114816 00000100:00100000:0.0:1789607648.482672:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114816 00000100:00100000:0.0:1789607648.482810:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114688 00000100:00100000:0.0:1789607648.482814:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114688 00000100:00100000:2.0:1789607648.483392:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607648.483416:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150114816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607648.483479:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607648.483566:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150114816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607648.483575:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607648.483599:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607648.483606:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150114688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607648.483629:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607648.483658:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150114688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607648.483664:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607648.484780:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150114816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607648.484812:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150114688:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789607648.546498:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607648.994778:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150114944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607648.994896:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.995009:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150114944 00000100:00100000:3.0:1789607648.995020:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150114944 00000100:00100000:3.0:1789607648.995090:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607648.995110:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150114944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607648.995157:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607648.995213:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150114944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.995220:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789607648.995243:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607648.995920:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150115072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607648.996034:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.996128:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150114944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607648.996156:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115072 00000100:00100000:3.0:1789607648.996161:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115072 00000100:00100000:3.0:1789607648.996197:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607648.996206:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150115072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607648.996224:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607648.996263:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150115072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.996270:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789607648.996288:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607648.996309:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150115072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607648.997114:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150115200:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.997168:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.997205:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150115712:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.997233:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.997252:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150116224:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.997295:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.997316:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607648.997323:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150115328:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.997351:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.997367:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150115840:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.997387:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.997421:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115200 00000100:00100000:3.0:1789607648.997429:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115200 00000100:00100000:3.0:1789607648.997469:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789607648.997485:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3468:x1876539150115200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.997542:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3468:x1876539150115200:12345-0@lo:400:kworker.0 Request processed in 65us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.997550:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789607648.997582:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115712 00000100:00100000:3.0:1789607648.997587:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115712 00000100:00100000:3.0:1789607648.998144:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150116224 00000100:00100000:3.0:1789607648.998150:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150116224 00000100:00100000:3.0:1789607648.998182:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115840 00000100:00100000:3.0:1789607648.998185:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115840 00000100:00100000:3.0:1789607648.998199:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607648.998207:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150115712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998248:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150115712:12345-0@lo:400:kworker.0 Request processed in 42us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.998254:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607648.998266:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607648.998272:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150116224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998299:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150116224:12345-0@lo:400:kworker.0 Request processed in 28us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.998315:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607648.998326:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607648.998337:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150115840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998366:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150115840:12345-0@lo:400:kworker.0 Request processed in 34us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.998371:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607648.998396:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115328 00000100:00100000:3.0:1789607648.998460:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115328 00000100:00100000:3.0:1789607648.998492:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607648.998556:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150115328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998590:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150115328:12345-0@lo:400:kworker.0 Request processed in 36us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.998743:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789607648.998791:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607648.998796:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607648.998814:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150115584:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998849:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.998898:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150116096:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998926:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.998948:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789607648.998955:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150115456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.998979:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.998996:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150115968:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999017:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607648.999041:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150116096 00000100:00100000:3.0:1789607648.999052:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150116096 00000100:00100000:3.0:1789607648.999083:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115456 00000100:00100000:3.0:1789607648.999086:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115456 00000100:00100000:3.0:1789607648.999098:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115968 00000100:00100000:3.0:1789607648.999100:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115968 00000100:00100000:3.0:1789607648.999117:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607648.999122:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150116096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999155:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150116096:12345-0@lo:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.999161:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607648.999172:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607648.999177:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999201:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150115456:12345-0@lo:400:kworker.0 Request processed in 24us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.999207:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607648.999218:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607648.999224:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999250:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150115968:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607648.999256:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789607648.999277:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607648.999280:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607648.999321:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150115328:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999338:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150115840:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999352:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150115200:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999365:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150115712:0@lo:400:kworker.0 00010000:00080000:3.0:1789607648.999390:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd5c380 x1876539150116224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607648.999806:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150116224:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999891:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150115456:0@lo:400:kworker.0 00010000:00080000:3.0:1789607648.999905:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd5df80 x1876539150115968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607648.999915:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150115968:0@lo:400:kworker.0 00000100:00100000:3.0:1789607648.999928:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150116096:0@lo:400:kworker.0 00000100:00100000:3.0:1789607649.000297:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150115584 00000100:00100000:3.0:1789607649.000305:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150115584 00000100:00100000:3.0:1789607649.000342:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607649.000350:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150115584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607649.000429:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150115584:12345-0@lo:400:kworker.0 Request processed in 79us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607649.000436:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607649.000474:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150115584:0@lo:400:kworker.0 00000001:00100000:1.0:1789607649.091509:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00000001:00100000:1.0:1789607649.091528:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000001:00100000:0.0:1789607649.092358:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000001:00100000:0.0:1789607649.092370:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00010000:00010000:0.0:1789607649.189336:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607649.382279:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789607649.566343:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000001:02000400:1.0:1789607649.662442:0:19025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789607650.210012:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607650.645844:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00010000:00010000:3.0:1789607651.235032:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607651.843418:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.843486:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109568 00000100:00100000:1.0:1789607651.843496:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109568 00000100:00100000:1.0:1789607651.843549:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:1.0:1789607651.843559:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:2396:x1876539130109568:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607651.843629:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:2396:x1876539130109568:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607651.843636:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:1.0:1789607651.847426:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607651.849315:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109696 00000100:00100000:3.0:1789607651.849327:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109696 00000100:00100000:3.0:1789607651.849429:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1789607651.849440:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2396:x1876539130109696:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607651.849520:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2396:x1876539130109696:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 83us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607651.849528:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:1.0:1789607651.849656:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849746:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849766:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849782:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849796:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849812:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849831:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607651.849852:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109952 00000100:00100000:1.0:1789607651.849855:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109952 00000100:00100000:3.0:1789607651.850149:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110464 00000100:00100000:3.0:1789607651.850155:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110464 00000100:00080000:2.0:1789607651.850201:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607651.850205:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607651.851103:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110208 00000100:00100000:2.0:1789607651.851110:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110208 00000100:00100000:2.0:1789607651.851154:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130109824 00000100:00100000:2.0:1789607651.851157:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130109824 00000100:00100000:2.0:1789607651.851180:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110336 00000100:00100000:2.0:1789607651.851183:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110336 00000100:00100000:2.0:1789607651.851200:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:2.0:1789607651.851209:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2395:x1876539130110208:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607651.851268:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2395:x1876539130110208:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 61us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607651.851276:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:2.0:1789607651.851291:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:2.0:1789607651.851299:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130109824:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607651.851322:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130109824:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607651.851328:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:2.0:1789607651.851339:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:2.0:1789607651.851346:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130110336:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607651.851370:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130110336:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607651.851375:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:2.0:1789607651.851394:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110080 00000100:00100000:2.0:1789607651.851397:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110080 00000100:00100000:2.0:1789607651.851415:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110592 00000100:00100000:2.0:1789607651.851418:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110592 00000100:00100000:2.0:1789607651.851432:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1789607651.851439:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130110080:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607651.851464:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130110080:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607651.851479:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1789607651.851491:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1789607651.851498:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130110592:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607651.851521:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130110592:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607651.851527:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00080000:2.0:1789607651.851663:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607651.851668:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607651.851670:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607651.855665:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:1.0:1789607651.855679:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130109952:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607651.855813:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130109952:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 136us (6156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607651.855820:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1789607651.856345:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1789607651.856354:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130110464:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607651.856394:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130110464:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (6627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607651.856401:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00010000:00010000:0.0:1789607652.265965:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607652.579766:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150116352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607652.579833:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607652.579926:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150116352 00000100:00100000:2.0:1789607652.579935:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150116352 00000100:00100000:2.0:1789607652.579982:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607652.579996:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150116352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607652.580033:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607652.580077:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150116352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.580083:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789607652.580102:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607652.580136:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150116352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607652.586632:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150116480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607652.586713:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607652.586797:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150116480 00000100:00100000:0.0:1789607652.586805:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150116480 00000100:00100000:0.0:1789607652.588906:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607652.588934:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150116480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607652.588962:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789607652.589822:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607652.592180:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150116480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3241us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.592194:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607652.596218:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150116480:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1789607652.864436:0:19176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe14280670 20000000:00000080:0.0:1789607652.864453:0:19176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d77c5c3f400 uarg=0000000000000000 20000000:01000000:0.0:1789607652.864487:0:19176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789607652.864493:0:19176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789607652.864498:0:19176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789607652.865436:0:19177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789607652.865693:0:19176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789607652.872328:0:19176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789607652.872359:0:19176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872376:0:19176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8be expref: 23 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872385:0:19176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 23 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872393:0:19176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbe90b expref: 23 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872399:0:19176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbea70 expref: 23 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872408:0:19176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872429:0:19176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 12 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872437:0:19176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872478:0:19176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 12 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.872494:0:19176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 12 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.872689:0:19176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116608:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607652.872989:0:19176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.873000:0:19176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 12 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.873009:0:19176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116736:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607652.873039:0:19176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbea70 expref: 23 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.873047:0:19176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbea70 expref: 23 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.873057:0:19176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116864:0@lo:104: 00000100:00100000:0.0:1789607652.873093:0:19176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607652.873130:0:19176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe90b expref: 23 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.873137:0:19176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe90b expref: 23 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.873145:0:19176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116992:0@lo:104: 00000100:00100000:0.0:1789607652.873179:0:19176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607652.873204:0:19176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 23 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.873212:0:19176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 23 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.873221:0:19176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150117120:0@lo:104: 00000100:00100000:0.0:1789607652.873241:0:19176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607652.873257:0:19176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbe8be expref: 23 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.873264:0:19176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbe8be expref: 23 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.873271:0:19176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150117248:0@lo:104: 00000100:00100000:0.0:1789607652.873290:0:19176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607652.873299:0:19176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ea4900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.873426:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150116864 00000100:00100000:1.0:1789607652.873433:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150116864 00000100:00100000:1.0:1789607652.873470:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150116992 00000100:00100000:1.0:1789607652.873474:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150116992 00000100:00100000:1.0:1789607652.873495:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117120 00000100:00100000:1.0:1789607652.873497:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117120 00000100:00100000:1.0:1789607652.873508:0:16412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117248 00000100:00100000:1.0:1789607652.873585:0:16412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117248 00000100:00100000:1.0:1789607652.873606:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607652.873614:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+6:19176:x1876539150116864:12345-0@lo:104: 00010000:00010000:1.0:1789607652.873627:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.873689:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607652.873695:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+6:19176:x1876539150116864:12345-0@lo:104: Request processed in 82us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.873712:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607652.873742:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607652.873749:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+5:19176:x1876539150116992:12345-0@lo:104: 00010000:00010000:1.0:1789607652.873757:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.873791:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607652.873796:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+5:19176:x1876539150116992:12345-0@lo:104: Request processed in 49us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.873802:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607652.873813:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607652.873819:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:19176:x1876539150117120:12345-0@lo:104: 00010000:00010000:1.0:1789607652.873825:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.873851:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789607652.873890:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+4:19176:x1876539150117120:12345-0@lo:104: Request processed in 70us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.873896:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607652.873908:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607652.873914:0:16412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:19176:x1876539150117248:12345-0@lo:104: 00010000:00010000:1.0:1789607652.873922:0:16412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.873950:0:16412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789607652.873955:0:16412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+3:19176:x1876539150117248:12345-0@lo:104: Request processed in 42us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.873961:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789607652.873977:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789607652.873982:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.873989:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607652.873994:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874002:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607652.874010:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607652.874016:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607652.874045:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874061:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607652.874080:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874087:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571f800/0xa26202d240fbea70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbea77 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874100:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607652.874103:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874108:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607652.874111:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874118:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607652.874125:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607652.874130:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607652.874140:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874145:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607652.874158:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874354:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185800/0xa26202d240fbe90b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe912 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874371:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607652.874374:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874380:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607652.874383:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874390:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607652.874395:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607652.874400:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607652.874413:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874419:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607652.874425:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874431:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9184800/0xa26202d240fbe8cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8d3 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874439:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607652.874442:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874456:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607652.874458:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874464:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607652.874470:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607652.874474:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607652.874485:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874490:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607652.874495:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.874500:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185400/0xa26202d240fbe8be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbe8c5 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.874693:0:19176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116864:0@lo:104: 00000100:00100000:0.0:1789607652.874771:0:19176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116992:0@lo:104: 00000100:00100000:0.0:1789607652.874780:0:19176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150117120:0@lo:104: 00000100:00100000:0.0:1789607652.874788:0:19176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150117248:0@lo:104: 00000100:00100000:2.0:1789607652.875123:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150117760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607652.875278:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150117376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607652.875307:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607652.875352:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607652.875354:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607652.875356:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607652.875367:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150117504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607652.875395:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150117632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607652.875434:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607652.875501:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607652.875607:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117760 00000100:00100000:0.0:1789607652.875614:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117760 00010000:00010000:0.0:1789607652.875636:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe8be expref: 24 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.875659:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117504 00000100:00100000:0.0:1789607652.875662:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117504 00010000:00010000:0.0:1789607652.875673:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe90b expref: 25 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.875687:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607652.875695:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+25:3470:x1876539150117760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607652.875796:0:16415:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789607652.875804:0:16415:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789607652.875819:0:16414:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789607652.875827:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607652.875838:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+25:3468:x1876539150117504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607652.875850:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607652.875856:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe90b expref: 25 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.875900:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe90b expref: 25 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.875916:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef9c00/0xa26202d240fbe912 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe90b expref: 25 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.875930:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607652.875963:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3468:x1876539150117504:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.875970:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607652.876001:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150117504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607652.876023:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607652.876046:0:16414:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789607652.876052:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117376 00000100:00100000:2.0:1789607652.876055:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117376 00010000:00010000:2.0:1789607652.876079:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbea70 expref: 24 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.876091:0:16414:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789607652.876097:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607652.876102:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150117376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607652.876108:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607652.876112:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbea70 expref: 24 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.876119:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbea70 expref: 24 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.876128:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075da00/0xa26202d240fbea77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbea70 expref: 24 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.876135:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607652.876160:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:3471:x1876539150117376:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.876270:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607652.876334:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607652.876339:0:16416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe8be expref: 23 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.876347:0:16416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe8be expref: 23 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.876357:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e000/0xa26202d240fbe8c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe8be expref: 23 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.876365:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607652.876400:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:3470:x1876539150117760:12345-0@lo:103:ldlm_bl.0 Request processed in 706us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.876406:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607652.876417:0:16416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789607652.876427:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117632 00000100:00100000:0.0:1789607652.876431:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117632 00010000:00010000:0.0:1789607652.876442:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 22 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.876454:0:16416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789607652.876459:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607652.876464:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:3469:x1876539150117632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607652.876471:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607652.876475:0:16416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 22 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.876481:0:16416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 22 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.876490:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbe8d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbe8cc expref: 22 pid: 16421 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.876498:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607652.876640:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3469:x1876539150117632:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.876647:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607652.877333:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150117760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607652.877370:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150117632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607652.877456:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607652.877677:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150117376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607652.878300:0:19176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116608:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607652.878310:0:19176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19176:1876539150116736:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607652.878342:0:19176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.882533:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607652.882582:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607652.882620:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110720 00000100:00100000:0.0:1789607652.882631:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110720 00010000:00010000:0.0:1789607652.882667:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 13 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.882735:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110848 00000100:00100000:0.0:1789607652.882740:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110848 00010000:00010000:0.0:1789607652.882754:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 14 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.882783:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1789607652.882793:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0558d189-bcbe-419b-abe6-53549136797c+14:2395:x1876539130110720:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607652.882808:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607652.882814:0:16416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 14 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.882826:0:16416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 14 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.882843:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf77a00/0xa26202d240fbebff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d0e expref: 14 pid: 16424 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.882857:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607652.882931:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0558d189-bcbe-419b-abe6-53549136797c+13:2395:x1876539130110720:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 139us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.882939:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1789607652.882953:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1789607652.882964:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+12:2395:x1876539130110848:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607652.882973:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607652.882979:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 12 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.882993:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 12 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883004:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c000/0xa26202d240fbebc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c9e expref: 12 pid: 16423 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883016:0:16415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883035:0:16415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883051:0:16415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883058:0:16415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883066:0:16415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883074:0:16415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883080:0:16415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607652.883084:0:16415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883092:0:16415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883112:0:16415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.883122:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607652.883153:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+11:2395:x1876539130110848:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 192us (569us total) trans 0 rc 0/0 00010000:00010000:0.0:1789607652.883159:0:19176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.883160:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00010000:00010000:0.0:1789607652.883180:0:19176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.883187:0:19176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec30 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.282094:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607653.608038:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607653.608061:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150117888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607653.608124:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.608171:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150117888 00000100:00100000:0.0:1789607653.608178:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150117888 00000100:00100000:0.0:1789607653.608221:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789607653.608228:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150117888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607653.608267:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607653.608308:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150117888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.608315:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789607653.613472:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150117888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607653.616326:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150118016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607653.616398:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.616488:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118016 00000100:00100000:3.0:1789607653.616508:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118016 00000100:00100000:3.0:1789607653.616558:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607653.616568:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150118016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607653.616603:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607653.616648:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150118016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.616655:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789607653.616739:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150118016:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1789607653.922905:0:16427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607653.922913:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78fd000800 from 13 10000000:01000000:2.0:1789607653.922918:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607653.922959:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.922972:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.922984:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607653.923018:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607653.923074:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.923112:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3098480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.923766:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118144 00000100:00100000:3.0:1789607653.923776:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118144 00000100:00100000:3.0:1789607653.923847:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789607653.923857:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c654f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:16427:x1876539150118144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607653.923888:0:16424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607653.923905:0:16424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e800/0xa26202d240fbec3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbec37 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.923930:0:16424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e800/0xa26202d240fbec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbec37 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.923940:0:16424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e800/0xa26202d240fbec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbec37 expref: 21 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.923949:0:16424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e800, rc 0) 00000100:00100000:3.0:1789607653.924009:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c654f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150118144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.924016:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789607653.924212:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607653.924229:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.924240:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607653.924302:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.924346:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.924367:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ea4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.924387:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118272 00000100:00100000:3.0:1789607653.924393:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118272 00000100:00100000:3.0:1789607653.924428:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607653.924436:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150118272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.924724:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150118272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.924732:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607653.924766:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.924798:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.925225:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.925244:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.925258:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118400 00000100:00100000:3.0:1789607653.925261:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118400 00000100:00100000:3.0:1789607653.925280:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789607653.925286:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78dbe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150118400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.925678:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78dbe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150118400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 390us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.925686:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789607653.925738:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789607653.926816:0:19204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789607653.926887:0:16427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789607653.926908:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607653.926919:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.926929:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607653.926939:0:16427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607653.926951:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c78e0000 from 13 10000000:01000000:3.0:1789607653.926965:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607653.926996:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.927005:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.927020:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607653.927041:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.927088:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.927109:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.927128:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118528 00000100:00100000:3.0:1789607653.927133:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118528 00000100:00100000:3.0:1789607653.927162:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789607653.927168:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:16427:x1876539150118528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607653.927295:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607653.927310:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77c571e200/0xa26202d240fbec4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbec45 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.927331:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77c571e200/0xa26202d240fbec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbec45 expref: 22 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.927340:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77c571e200/0xa26202d240fbec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbec45 expref: 22 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.927347:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77c571e200, rc 0) 00000100:00100000:3.0:1789607653.927381:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150118528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.927394:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789607653.927434:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607653.927448:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.927456:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607653.927519:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.927548:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.927611:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0625f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607653.927644:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118656 00000100:00100000:2.0:1789607653.927651:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118656 00000100:00100000:2.0:1789607653.927690:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789607653.927700:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150118656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607653.927960:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150118656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607653.927967:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789607653.928156:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.928188:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607653.928248:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.928278:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0625f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607653.928282:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118784 00000100:00100000:2.0:1789607653.928288:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118784 00000100:00100000:2.0:1789607653.928320:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789607653.928328:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fac83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150118784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607653.928466:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fac83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150118784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607653.928472:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789607653.928531:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607653.930204:0:19205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789607653.934091:0:16427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789607653.934126:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607653.934138:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.934152:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607653.934164:0:16427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607653.934183:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78d9435000 from 13 10000000:01000000:2.0:1789607653.934186:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607653.934222:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.934231:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.934241:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607653.934268:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607653.934330:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.934379:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607653.936097:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150118912 00000100:00100000:1.0:1789607653.936109:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150118912 00000100:00100000:1.0:1789607653.936165:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607653.936176:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d79020c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:16427:x1876539150118912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607653.936192:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607653.936208:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbec5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbec53 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.936234:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbec5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbec53 expref: 23 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.936245:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbec5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbec53 expref: 23 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.936254:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77000, rc 0) 00000100:00100000:1.0:1789607653.936322:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d79020c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150118912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607653.936329:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607653.936382:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150118912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607653.936399:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.936409:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607653.936467:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607653.936503:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607653.936521:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607653.937513:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119040 00000100:00100000:0.0:1789607653.937523:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119040 00000100:00100000:0.0:1789607653.937570:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607653.937578:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d277b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150119040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.937857:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d277b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150119040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.937890:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789607653.937935:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.937975:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.938013:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.938039:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ea4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607653.938052:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119168 00000100:00100000:0.0:1789607653.938055:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119168 00000100:00100000:0.0:1789607653.938077:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789607653.938083:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150119168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.938215:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150119168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.938222:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789607653.938257:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607653.938906:0:19207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789607653.938956:0:16427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789607653.938972:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607653.938989:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939000:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607653.939009:0:16427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789607653.939012:0:16427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c419c000 from 13 10000000:01000000:0.0:1789607653.939014:0:16427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789607653.939043:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939051:0:16427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939060:0:16427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607653.939077:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.939112:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.939132:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ea4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607653.939148:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119296 00000100:00100000:0.0:1789607653.939153:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119296 00000100:00100000:0.0:1789607653.939180:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789607653.939187:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d277b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:16427:x1876539150119296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607653.939197:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607653.939209:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbec61 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939230:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbec61 expref: 24 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939247:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbec61 expref: 24 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939256:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c600, rc 0) 00000100:00100000:0.0:1789607653.939288:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d277b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150119296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.939295:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789607653.939332:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607653.939345:0:16427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.939354:0:16427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607653.939393:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.939416:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.939428:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ea4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607653.939437:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119424 00000100:00100000:0.0:1789607653.939440:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119424 00000100:00100000:0.0:1789607653.939461:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607653.939468:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150119424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.939668:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150119424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.939675:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607653.939706:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.939751:0:16427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.939785:0:16427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.939797:0:16427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ea4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607653.939807:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119552 00000100:00100000:0.0:1789607653.939810:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119552 00000100:00100000:0.0:1789607653.939829:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789607653.939836:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d2779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150119552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607653.939981:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d2779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:16427:x1876539150119552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.939987:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789607653.940021:0:16427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7095b5c7-e12e-406f-ad0b-bb55e8b45703:16427:1876539150119552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607653.954150:0:19208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789607653.955161:0:16427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789607653.955192:0:16427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607653.955203:0:16427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.955217:0:16427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607654.019554:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607654.019691:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130110976 00000100:00100000:0.0:1789607654.019702:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130110976 00000100:00100000:0.0:1789607654.019819:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:0.0:1789607654.019829:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+11:15021:x1876539130110976:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607654.019845:0:16423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607654.019904:0:16423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78e075c800/0xa26202d240fbec6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d46 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607654.019939:0:16423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78e075c800/0xa26202d240fbec6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d46 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607654.019951:0:16423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78e075c800/0xa26202d240fbec6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d46 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607654.019983:0:16423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c800, rc 0) 00000100:00100000:0.0:1789607654.020035:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+12:15021:x1876539130110976:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 208us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.020041:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:3.0:1789607654.022341:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607654.022659:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111104 00000100:00100000:2.0:1789607654.022669:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111104 00000100:00100000:2.0:1789607654.022735:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:2.0:1789607654.022746:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+12:15021:x1876539130111104:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607654.023224:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+12:15021:x1876539130111104:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 478us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607654.023232:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:3.0:1789607654.027256:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607654.027355:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111232 00000100:00100000:1.0:1789607654.027364:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111232 00000100:00100000:1.0:1789607654.027413:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00100000:1.0:1789607654.027424:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+12:15021:x1876539130111232:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607654.027698:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+12:15021:x1876539130111232:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 269us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607654.027706:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00100000:3.0:1789607654.031906:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607654.031989:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111360 00000100:00100000:1.0:1789607654.031999:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111360 00000100:00100000:1.0:1789607654.032054:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:1.0:1789607654.032063:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+12:15021:x1876539130111360:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607654.032079:0:16421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607654.032095:0:16421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf77600/0xa26202d240fbec76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d4d expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607654.032122:0:16421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf77600/0xa26202d240fbec76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d4d expref: 13 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607654.032150:0:16421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf77600/0xa26202d240fbec76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d4d expref: 13 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607654.032160:0:16421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77600, rc 0) 00000100:00100000:1.0:1789607654.032202:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+13:15021:x1876539130111360:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 140us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607654.032208:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:0.0:1789607654.050136:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607654.050211:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111488 00000100:00100000:1.0:1789607654.050222:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111488 00000100:00100000:1.0:1789607654.050274:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:1.0:1789607654.050283:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:15021:x1876539130111488:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607654.050537:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:15021:x1876539130111488:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 254us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607654.050544:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:1.0:1789607654.063292:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607654.066829:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111616 00000100:00100000:0.0:1789607654.066845:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111616 00000100:00100000:0.0:1789607654.066948:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:0.0:1789607654.066959:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15021:x1876539130111616:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607654.067170:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:15021:x1876539130111616:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 211us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.067179:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:3.0:1789607654.114940:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150119680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607654.115008:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115527:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150119936:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.115561:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115580:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150120448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.115598:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115610:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150120960:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.115632:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115652:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789607654.115658:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150119808:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.115684:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115742:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150120320:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.115765:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115781:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150120832:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.115799:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607654.115825:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120960 00000100:00100000:1.0:1789607654.115832:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120960 00000100:00100000:1.0:1789607654.116036:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120320 00000100:00100000:1.0:1789607654.116041:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120320 00000100:00100000:1.0:1789607654.116056:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120832 00000100:00100000:1.0:1789607654.116059:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120832 00000100:00100000:1.0:1789607654.116076:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607654.116084:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.116133:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150120960:12345-0@lo:400:kworker.0 Request processed in 50us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607654.116140:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607654.116157:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789607654.116163:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.116186:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150120320:12345-0@lo:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607654.116191:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789607654.116200:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789607654.116205:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150120832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.116226:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150120832:12345-0@lo:400:kworker.0 Request processed in 22us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607654.116231:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789607654.116252:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607654.116256:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789607654.116287:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150120320:0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.116297:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150120832:0@lo:400:kworker.0 00010000:00080000:1.0:1789607654.116307:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efc380 x1876539150120960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607654.116316:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150120960:0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.116457:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119936 00000100:00100000:3.0:1789607654.116462:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119936 00000100:00100000:3.0:1789607654.116489:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120448 00000100:00100000:3.0:1789607654.116492:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120448 00000100:00100000:3.0:1789607654.116504:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607654.116510:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150119936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.116549:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150119936:12345-0@lo:400:kworker.0 Request processed in 39us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607654.116555:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607654.116567:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607654.116573:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150120448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.116598:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150120448:12345-0@lo:400:kworker.0 Request processed in 26us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607654.116604:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607654.116621:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119808 00000100:00100000:3.0:1789607654.116624:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119808 00000100:00100000:3.0:1789607654.116645:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789607654.116650:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150119808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.116676:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150119808:12345-0@lo:400:kworker.0 Request processed in 26us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607654.116682:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789607654.118039:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150120064:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.118091:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118122:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150120576:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.118145:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118163:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150121088:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.118183:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118205:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789607654.118212:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150120192:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.118234:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118252:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150120704:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.118270:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118297:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150121216:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.118318:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118350:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150119680 00000100:00100000:0.0:1789607654.118356:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150119680 00000100:00100000:0.0:1789607654.118402:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607654.118410:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150119680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607654.118443:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607654.118480:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150119680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607654.118602:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150119808:0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.118620:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150119936:0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.118629:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150120448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.118647:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607654.118653:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150121344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607654.118677:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607654.118773:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607654.118788:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150121344 00000100:00100000:0.0:1789607654.118791:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150121344 00000100:00100000:0.0:1789607654.118807:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607654.118813:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150121344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607654.118823:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607654.119365:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150121344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 549us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.119372:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607654.119425:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120064 00000100:00100000:0.0:1789607654.119429:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120064 00000100:00100000:0.0:1789607654.119455:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120576 00000100:00100000:0.0:1789607654.119458:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120576 00000100:00100000:0.0:1789607654.119476:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120192 00000100:00100000:0.0:1789607654.119479:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120192 00000100:00100000:0.0:1789607654.119770:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607654.119778:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150120064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.119828:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150120064:12345-0@lo:400:kworker.0 Request processed in 52us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.119846:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607654.121132:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607654.121181:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607654.121261:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150120064:0@lo:400:kworker.0 00000100:00100000:3.0:1789607654.121398:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150119680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607654.121815:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150120576:12345-0@lo:400:kworker.0 Request processed in 666us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.121823:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607654.121847:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607654.121854:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150120192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.122669:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150120192:12345-0@lo:400:kworker.0 Request processed in 812us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.122678:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607654.122728:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150121088 00000100:00100000:0.0:1789607654.122735:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150121088 00000100:00100000:0.0:1789607654.122771:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150120704 00000100:00100000:0.0:1789607654.122774:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150120704 00000100:00100000:0.0:1789607654.122786:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150121216 00000100:00100000:0.0:1789607654.122788:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150121216 00000100:00100000:0.0:1789607654.122803:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607654.122810:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150121088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.122842:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150121088:12345-0@lo:400:kworker.0 Request processed in 32us (4658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.122848:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607654.123010:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607654.123019:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150120704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.123065:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150120704:12345-0@lo:400:kworker.0 Request processed in 48us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.123080:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607654.123094:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607654.123099:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.123127:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150121216:12345-0@lo:400:kworker.0 Request processed in 29us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.123133:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789607654.123160:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607654.123164:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607654.123166:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607654.123169:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607654.124539:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150121344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607654.124578:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150120192:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.124589:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150120704:0@lo:400:kworker.0 00010000:00080000:0.0:1789607654.124601:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7900efd880 x1876539150121216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607654.124612:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150121216:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.124623:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150120576:0@lo:400:kworker.0 00000100:00100000:0.0:1789607654.124633:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150121088:0@lo:400:kworker.0 00010000:00010000:3.0:1789607654.307766:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607655.330074:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607656.354946:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607656.842081:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.842270:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111744 00000100:00100000:1.0:1789607656.842280:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111744 00000100:00080000:0.0:1789607656.842395:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607656.842435:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1789607656.842446:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+6:15688:x1876539130111744:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607656.842465:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607656.842484:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbec7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d54 expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842540:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842568:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842580:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842594:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842600:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842621:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842968:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77a00/0xa26202d240fbec92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842979:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77a00/0xa26202d240fbec92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.842987:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77a00/0xa26202d240fbec92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607656.843012:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607656.843015:0:17627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607656.843051:0:17627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77a00/0xa26202d240fbec92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843060:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843066:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843072:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843077:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607656.843081:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843087:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843107:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:1.0:1789607656.843110:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607656.843115:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843121:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbec84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843145:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843151:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843157:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843162:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607656.843166:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843172:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843179:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d78d2475f00) 00010000:00010000:1.0:1789607656.843182:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607656.843186:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843192:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbec8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843235:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbec7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d54 expref: 8 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843249:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77a00/0xa26202d240fbec92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d54 expref: 7 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.843255:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78d2475200) 00010000:00010000:1.0:1789607656.843257:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607656.843259:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77a00, rc 0) 00000100:00100000:1.0:1789607656.843327:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15688:x1876539130111744:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 883us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.843336:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1789607656.848751:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607656.849279:0:16439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130111872 00000100:00100000:3.0:1789607656.849290:0:16439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130111872 00000100:00100000:3.0:1789607656.849347:0:16439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1789607656.849358:0:16439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15688:x1876539130111872:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789607656.849447:0:16439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15688:x1876539130111872:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 Request processed in 91us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607656.849454:0:16439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1789607656.852991:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607656.856376:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112128 00000100:00100000:0.0:1789607656.856408:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112128 00000100:00100000:0.0:1789607656.856474:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:0.0:1789607656.856487:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15688:x1876539130112128:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607656.856509:0:16429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607656.856531:0:16429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d400/0xa26202d240fbec99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d5b expref: -99 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.856617:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.856632:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.856645:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.856706:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.856714:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.856720:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.857113:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075da00/0xa26202d240fbecae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.857122:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075da00/0xa26202d240fbecae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.857130:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075da00/0xa26202d240fbecae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607656.857784:0:16429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789607656.858367:0:16429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858378:0:16429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858384:0:16429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858390:0:16429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075de00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607656.858394:0:16429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858402:0:16429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858415:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78d2475200) 00010000:00010000:0.0:1789607656.858418:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607656.858423:0:16429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858430:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbeca0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858442:0:16429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858447:0:16429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858464:0:16429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858469:0:16429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075ce00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607656.858473:0:16429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858479:0:16429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858487:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607656.858489:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607656.858492:0:16429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.858498:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeca7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.863910:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d400/0xa26202d240fbec99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d5b expref: 10 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.863936:0:16429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075da00/0xa26202d240fbecae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d5b expref: 9 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.863946:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c73e1100) 00010000:00010000:0.0:1789607656.863950:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607656.863953:0:16429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075da00, rc 0) 00000100:00100000:0.0:1789607656.864024:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15688:x1876539130112128:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 7538us (11040us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789607656.864044:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:0.0:1789607656.871954:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607656.872345:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112256 00000100:00100000:2.0:1789607656.872355:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112256 00000100:00100000:2.0:1789607656.872413:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607656.872424:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15688:x1876539130112256:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789607656.872525:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15688:x1876539130112256:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 103us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607656.872532:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607656.885750:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607656.885933:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112384 00000100:00100000:3.0:1789607656.885943:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112384 00000100:00100000:1.0:1789607656.886179:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:1.0:1789607656.886192:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15688:x1876539130112384:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789607656.887808:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789607656.900389:0:16429:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 14152us 00000100:00100000:1.0:1789607656.921452:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15688:x1876539130112384:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 35256us (35703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.921465:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:2.0:1789607656.956109:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607656.956239:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112512 00000100:00100000:0.0:1789607656.956248:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112512 00000100:00100000:0.0:1789607656.956295:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1789607656.956302:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15694:x1876539130112512:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607656.956319:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607656.956336:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d400/0xa26202d240fbecbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d62 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956384:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956395:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956406:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956420:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956427:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956433:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956637:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956650:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956657:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956663:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075ce00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607656.956668:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956676:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956687:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:0.0:1789607656.956702:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607656.956707:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956713:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbecc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956725:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956730:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956735:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956739:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075de00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607656.956747:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956753:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956760:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607656.956763:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607656.956766:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956771:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbecca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956800:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d400/0xa26202d240fbecbc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d62 expref: 10 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956810:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:0.0:1789607656.956812:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607656.956815:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d400/0xa26202d240fbecbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d62 expref: 10 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607656.956825:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d400, rc 0) 00000100:00100000:0.0:1789607656.956931:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15694:x1876539130112512:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 627us (829us total) trans 0 rc 301/301 00000100:00100000:0.0:1789607656.956938:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1789607656.962638:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.962788:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112640 00000100:00100000:1.0:1789607656.962798:0:16437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112640 00000100:00100000:1.0:1789607656.962855:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607656.962902:0:16437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15694:x1876539130112640:12345-192.168.203.25@tcp:700:lfs.0 00000100:00100000:1.0:1789607656.962985:0:16437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15694:x1876539130112640:12345-192.168.203.25@tcp:700:lfs.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.963009:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607656.963453:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.963489:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.963510:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.963543:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.963561:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.963581:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607656.963616:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113152 00000100:00100000:1.0:1789607656.963623:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113152 00000100:00100000:1.0:1789607656.963659:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113280 00000100:00100000:1.0:1789607656.963662:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113280 00000100:00100000:1.0:1789607656.963687:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607656.963707:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2396:x1876539130113152:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607656.963748:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2396:x1876539130113152:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.963754:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607656.963769:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1789607656.963772:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112896 00000100:00100000:1.0:1789607656.963775:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130113280:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607656.963776:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112896 00000100:00100000:1.0:1789607656.963801:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130113280:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.963807:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1789607656.963811:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113408 00000100:00100000:0.0:1789607656.963813:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113408 00000100:00100000:2.0:1789607656.963820:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113024 00000100:00100000:2.0:1789607656.963828:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113024 00000100:00080000:1.0:1789607656.963840:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607656.963844:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00080000:1.0:1789607656.963846:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607656.963848:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607656.963851:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607656.963853:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c5239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2396:x1876539130112896:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607656.963901:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c5239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2396:x1876539130112896:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 50us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607656.963907:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1789607656.963919:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2396:x1876539130113408:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607656.963950:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2396:x1876539130113408:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 35us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.964019:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607656.964034:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130113024:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607656.964084:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1789607656.964103:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130112768 00000100:00100000:3.0:1789607656.964110:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130112768 00000100:00100000:1.0:1789607656.964113:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2395:x1876539130113024:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 80us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.964121:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1789607656.964151:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 163 00000100:00100000:3.0:1789607656.964160:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:2395:x1876539130112768:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607656.964191:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:2395:x1876539130112768:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607656.964198:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 163 00000100:00100000:1.0:1789607656.964254:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607656.964309:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1789607656.964828:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113536 00000100:00100000:1.0:1789607656.964833:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113536 00000100:00080000:0.0:1789607656.964853:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607656.964898:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:1.0:1789607656.964906:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130113536:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607656.964951:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2395:x1876539130113536:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 46us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.965007:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:1.0:1789607656.966163:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607656.966551:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113792 00000100:00100000:2.0:1789607656.966558:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113792 00000100:00100000:2.0:1789607656.966609:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:2.0:1789607656.966618:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+9:15694:x1876539130113792:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:2.0:1789607656.966680:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607656.967991:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbebea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ccf expref: 9 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.968018:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:2.0:1789607656.968022:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607656.969628:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.969657:0:16429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 5 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.970769:0:16429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.971339:0:16429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 5 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.971357:0:16429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 5 pid: 16428 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607656.971374:0:16429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cfc7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16429:1876539150121472:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607656.971534:0:16429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c30713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607656.976780:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607656.977733:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130113920 00000100:00100000:0.0:1789607656.977743:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130113920 00010000:00010000:0.0:1789607656.977785:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 6 pid: 16428 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607656.977825:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1789607656.978420:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2396:x1876539130113920:12345-192.168.203.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789607656.978550:0:16429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cfc7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16429:1876539150121472:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607656.978576:0:16429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979564:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607656.979578:0:16416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 6 pid: 16428 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979594:0:16416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 6 pid: 16428 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979616:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbec29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d3f expref: 6 pid: 16428 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979650:0:16416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:1.0:1789607656.979656:0:16416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979666:0:16416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979674:0:16416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607656.979727:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607656.979787:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2396:x1876539130113920:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1953us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607656.979797:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00010000:00010000:2.0:1789607656.980160:0:16429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.980169:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.980191:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.980202:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.980210:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981610:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981624:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981645:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607656.981660:0:16429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e852f40 reply state 000000008343d038 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981671:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981678:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607656.981681:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607656.981685:0:16429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789607656.981699:0:16429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607656.981708:0:16429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981715:0:16429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981723:0:16429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981728:0:16429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607656.981733:0:16429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981740:0:16429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981750:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:2.0:1789607656.981752:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607656.981762:0:16429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981769:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbecd1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607656.981788:0:16429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e852f40 reply state 000000008343d038 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981796:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607656.981802:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d78c6f8c500) 00010000:00010000:2.0:1789607656.981805:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607656.981807:0:16429:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789607656.981910:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+10:15694:x1876539130113792:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 15290us (15748us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789607656.981919:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:3.0:1789607657.055002:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607657.055105:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130114048 00000100:00100000:0.0:1789607657.055115:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130114048 00000100:00100000:0.0:1789607657.055173:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:0.0:1789607657.055183:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+10:15702:x1876539130114048:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:0.0:1789607657.055205:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607657.055228:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbece6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d69 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.055291:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.055305:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.055321:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607657.055369:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607657.055374:0:16430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607657.055410:0:16430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.055434:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbece6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d69 expref: 12 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.055452:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d69 expref: 11 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.055460:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607657.055463:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607657.055467:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075ce00, rc 0) 00000100:00100000:0.0:1789607657.055615:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+11:15702:x1876539130114048:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 432us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607657.055622:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:0.0:1789607657.083974:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.084480:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130114176 00000100:00100000:1.0:1789607657.084491:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130114176 00000100:00100000:1.0:1789607657.084554:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1789607657.084565:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:15703:x1876539130114176:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607657.084584:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607657.084614:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbecf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d70 expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.084684:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76c00/0xa26202d240fbecfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.084709:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76c00/0xa26202d240fbecfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.084739:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76c00/0xa26202d240fbecfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607657.084774:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607657.084778:0:17627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607657.084799:0:17627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76c00/0xa26202d240fbecfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.084825:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbecf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d70 expref: 7 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.084843:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76c00/0xa26202d240fbecfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d70 expref: 6 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.084852:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607657.084855:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607657.084859:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76c00, rc 0) 00000100:00100000:1.0:1789607657.084973:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15703:x1876539130114176:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 409us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607657.084980:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:2.0:1789607657.089108:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.089400:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130114304 00000100:00100000:3.0:1789607657.089410:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130114304 00000100:00100000:3.0:1789607657.089465:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:3.0:1789607657.089475:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:15703:x1876539130114304:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607657.089495:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607657.089527:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbed02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d77 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.089589:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.089617:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.089629:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.089856:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.089894:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.089902:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090001:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbed17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090009:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbed17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090017:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbed17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607657.090047:0:16428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607657.090051:0:16428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607657.090076:0:16428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbed17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090096:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090103:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090109:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090115:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607657.090119:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090126:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090137:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:3.0:1789607657.090140:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607657.090144:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090150:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571f800/0xa26202d240fbed09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090163:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090170:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090175:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090186:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607657.090189:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090195:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090204:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d78c6f8c500) 00010000:00010000:3.0:1789607657.090206:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607657.090209:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090214:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571fc00/0xa26202d240fbed10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090241:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbed02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d77 expref: 8 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090252:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbed17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d77 expref: 7 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.090258:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:3.0:1789607657.090260:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607657.090262:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185400, rc 0) 00000100:00100000:3.0:1789607657.090312:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+7:15703:x1876539130114304:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 838us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607657.090319:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:0.0:1789607657.094561:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.094670:0:16440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130114432 00000100:00100000:2.0:1789607657.094696:0:16440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130114432 00000100:00100000:2.0:1789607657.094759:0:16440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1789607657.094770:0:16440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:15703:x1876539130114432:12345-192.168.203.25@tcp:900:lfs.0 00000100:00100000:2.0:1789607657.094892:0:16440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:15703:x1876539130114432:12345-192.168.203.25@tcp:900:lfs.0 Request processed in 92us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607657.094901:0:16440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:0.0:1789607657.101351:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.101440:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130114688 00000100:00100000:1.0:1789607657.101450:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130114688 00000100:00100000:1.0:1789607657.101508:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:1.0:1789607657.101523:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+7:15703:x1876539130114688:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607657.101546:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607657.101567:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d7e expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607657.101684:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607657.101812:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d7e expref: 9 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.101826:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607657.101829:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607657.101835:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d7e expref: 9 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.101892:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77800, rc 0) 00000100:00100000:1.0:1789607657.101944:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+8:15703:x1876539130114688:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 424us (602us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789607657.101951:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:0.0:1789607657.105244:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.105321:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130114944 00000100:00100000:1.0:1789607657.105331:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130114944 00000100:00100000:1.0:1789607657.105386:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:1.0:1789607657.105397:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+8:15703:x1876539130114944:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:1.0:1789607657.105455:0:16430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607657.105480:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185400/0xa26202d240fbed17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d77 expref: 8 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.105499:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607657.105504:0:16430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607657.105526:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.105555:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.105565:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607657.105791:0:16430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007580ca3d reply state 0000000057a4c1cc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.105804:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.105811:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607657.105814:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789607657.105817:0:16430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789607657.105824:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789607657.105925:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+9:15703:x1876539130114944:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 530us (690us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789607657.105932:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1789607657.113046:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.113126:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130115200 00000100:00100000:3.0:1789607657.113148:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130115200 00000100:00100000:3.0:1789607657.113203:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:3.0:1789607657.113214:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+9:15703:x1876539130115200:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607657.113449:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+10:15703:x1876539130115200:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 236us (410us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789607657.113457:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:0.0:1789607657.116839:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.117154:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130115456 00000100:00100000:1.0:1789607657.117164:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130115456 00000100:00100000:1.0:1789607657.117217:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:1.0:1789607657.117228:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+10:15703:x1876539130115456:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607657.117251:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607657.117271:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d85 expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117340:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117368:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117380:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117392:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117399:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117406:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607657.117508:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607657.117601:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117611:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117618:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117623:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607657.117628:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117636:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117659:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607657.117662:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607657.117796:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117804:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117818:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117825:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117830:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.117835:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607657.117838:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.118164:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.118174:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d78c6f8c500) 00010000:00010000:1.0:1789607657.118176:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607657.118179:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.118185:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.118237:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d85 expref: 12 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.118247:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607657.118249:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607657.118253:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d85 expref: 12 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.118263:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77800, rc 0) 00000100:00100000:1.0:1789607657.118330:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+11:15703:x1876539130115456:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1104us (1498us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789607657.118338:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:2.0:1789607657.121102:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.121171:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130115584 00000100:00100000:1.0:1789607657.121180:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130115584 00000100:00100000:1.0:1789607657.121235:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1789607657.121245:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+11:15703:x1876539130115584:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607657.121268:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607657.121287:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbed4f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d8c expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.121370:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.121382:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.121395:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607657.121434:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607657.121438:0:16430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607657.121456:0:16430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.121481:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbed4f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 13 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.121500:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 12 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.121508:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607657.121510:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607657.121514:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76200, rc 0) 00000100:00100000:1.0:1789607657.121571:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+12:15703:x1876539130115584:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 327us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607657.121577:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:0.0:1789607657.125300:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.125386:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130115712 00000100:00100000:3.0:1789607657.125396:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130115712 00000100:00100000:3.0:1789607657.125449:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:3.0:1789607657.125459:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+12:15703:x1876539130115712:12345-192.168.203.25@tcp:37:lfs.0 00000100:00100000:2.0:1789607657.131406:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+12:15703:x1876539130115712:12345-192.168.203.25@tcp:37:lfs.0 Request processed in 5938us (6107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607657.131432:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:2.0:1789607657.140277:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.140372:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130115968 00000100:00100000:1.0:1789607657.140381:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130115968 00000100:00100000:1.0:1789607657.140434:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1789607657.140444:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c7b8c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+12:15703:x1876539130115968:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607657.140719:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c7b8c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+13:15703:x1876539130115968:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 275us (451us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789607657.140727:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607657.188708:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.188854:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130116096 00000100:00100000:2.0:1789607657.188883:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130116096 00000100:00100000:2.0:1789607657.188951:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:2.0:1789607657.188962:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+11:15709:x1876539130116096:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1789607657.188983:0:16429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607657.189003:0:16429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbed5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d93 expref: -99 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189074:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189088:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189099:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189109:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189115:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189121:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189202:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbed72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189219:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbed72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189226:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbed72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607657.189252:0:16429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607657.189256:0:16429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607657.189297:0:16429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbed72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189309:0:16429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189315:0:16429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189320:0:16429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189326:0:16429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607657.189330:0:16429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189336:0:16429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189347:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:2.0:1789607657.189349:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607657.189353:0:16429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189369:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbed64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189383:0:16429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189391:0:16429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189397:0:16429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189401:0:16429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607657.189405:0:16429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189411:0:16429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189423:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d78c6f8c500) 00010000:00010000:2.0:1789607657.189426:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607657.189429:0:16429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189435:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbed6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189460:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbed5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d93 expref: 13 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189487:0:16429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbed72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d93 expref: 12 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.189494:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607657.189496:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789607657.189499:0:16429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580800, rc 0) 00000100:00100000:2.0:1789607657.189557:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+12:15709:x1876539130116096:12345-192.168.203.25@tcp:101:bash.0 Request processed in 597us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607657.189564:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:0.0:1789607657.197247:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.197333:0:16440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130116224 00000100:00100000:2.0:1789607657.197344:0:16440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130116224 00000100:00100000:2.0:1789607657.197404:0:16440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1789607657.197416:0:16440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15709:x1876539130116224:12345-192.168.203.25@tcp:900:bash.0 00000100:00100000:2.0:1789607657.197499:0:16440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15709:x1876539130116224:12345-192.168.203.25@tcp:900:bash.0 Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607657.197506:0:16440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1789607657.199956:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.200115:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130116480 00000100:00100000:1.0:1789607657.200126:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130116480 00000100:00100000:1.0:1789607657.200493:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:1.0:1789607657.200505:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+12:15709:x1876539130116480:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607657.200525:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607657.200543:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbed79 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668d9a expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.200660:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.200685:0:16430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 12 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.200701:0:16430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.200735:0:16430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 12 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.200749:0:16430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 12 pid: 16430 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607657.200762:0:16430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16430:1876539150121600:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607657.200848:0:16430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607657.208629:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.209895:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130116608 00000100:00100000:3.0:1789607657.209908:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130116608 00010000:00010000:3.0:1789607657.209952:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 13 pid: 16430 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607657.210002:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607657.210013:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+13:2396:x1876539130116608:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607657.210029:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607657.210036:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 13 pid: 16430 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.210050:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 13 pid: 16430 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.210072:0:16415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:3.0:1789607657.210077:0:16415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.210100:0:16415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.210107:0:16415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.210126:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607657.210188:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+13:2396:x1876539130116608:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 176us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607657.210195:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00010000:00010000:1.0:1789607657.212227:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbed56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d8c expref: 12 pid: 16430 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607657.212251:0:16430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16430:1876539150121600:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607657.212547:0:16430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.212572:0:16430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.212578:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.212604:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.212617:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.212626:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213556:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213569:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213577:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607657.213588:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789607657.213617:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213625:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213632:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213645:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607657.213649:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213657:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213668:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607657.213671:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607657.213676:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213681:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbed80 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607657.213703:0:16430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dded48ff reply state 00000000245c2582 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213713:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213719:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d78d2475f00) 00010000:00010000:1.0:1789607657.213721:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607657.213724:0:16430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607657.213758:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbed79 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 15 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213773:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 14 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.213791:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607657.213793:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789607657.213796:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76400, rc 0) 00000100:00100000:1.0:1789607657.214009:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+15:15709:x1876539130116480:12345-192.168.203.25@tcp:101:bash.0 Request processed in 13506us (14060us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789607657.214017:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:0.0:1789607657.251557:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.251680:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130116736 00000100:00100000:2.0:1789607657.251700:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130116736 00000100:00100000:2.0:1789607657.251755:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:2.0:1789607657.251766:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+15:15709:x1876539130116736:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1789607657.251788:0:16429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607657.251807:0:16429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbed9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668da1 expref: -99 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.251904:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.251931:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.251943:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607657.251982:0:16429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789607657.251986:0:16429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607657.252003:0:16429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.252014:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.252040:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbed9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668da1 expref: 17 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.252059:0:16429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668da1 expref: 16 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.252067:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607657.252070:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607657.252074:0:16429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581e00, rc 0) 00000100:00100000:2.0:1789607657.252136:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+16:15709:x1876539130116736:12345-192.168.203.25@tcp:101:bash.0 Request processed in 372us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607657.252143:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:0.0:1789607657.255500:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.255586:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130116992 00000100:00100000:1.0:1789607657.255595:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130116992 00000100:00100000:1.0:1789607657.255651:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1789607657.255662:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+16:15709:x1876539130116992:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:1.0:1789607657.256050:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+17:15709:x1876539130116992:12345-192.168.203.25@tcp:35:bash.0 Request processed in 389us (557us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789607657.256058:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1789607657.354035:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.354410:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130117248 00000100:00100000:3.0:1789607657.354424:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130117248 00000100:00100000:3.0:1789607657.354522:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:3.0:1789607657.354535:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+17:15719:x1876539130117248:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607657.354584:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607657.354617:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668da8 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607657.355349:0:16428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789607657.355537:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668da8 expref: 19 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.355752:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:3.0:1789607657.355757:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607657.355765:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668da8 expref: 19 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.355787:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:3.0:1789607657.356239:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+18:15719:x1876539130117248:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1703us (2216us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789607657.356248:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:0.0:1789607657.360224:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.360361:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130117504 00000100:00100000:1.0:1789607657.360374:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130117504 00000100:00100000:1.0:1789607657.360458:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:1.0:1789607657.360472:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+18:15719:x1876539130117504:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607657.360834:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+19:15719:x1876539130117504:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 364us (624us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789607657.360844:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00010000:00010000:0.0:1789607657.378181:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607657.423785:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.424088:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130117760 00000100:00100000:2.0:1789607657.424104:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130117760 00000100:00100000:2.0:1789607657.424203:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:2.0:1789607657.424237:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+19:15722:x1876539130117760:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607657.424274:0:16429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607657.424302:0:16429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbedb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668daf expref: -99 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.424438:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedbf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.424457:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.424472:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607657.424486:0:16429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789607657.424654:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbedb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668daf expref: 22 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.424678:0:16429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668daf expref: 21 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.424696:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607657.424699:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607657.424770:0:16429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607657.424853:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+21:15722:x1876539130117760:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 621us (1083us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789607657.424925:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:3.0:1789607657.431194:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.431301:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.431523:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130118016 00000100:00100000:2.0:1789607657.431538:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130118016 00000100:00100000:2.0:1789607657.431652:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1789607657.431674:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+21:2396:x1876539130118016:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607657.431705:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607657.431736:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668daf expref: 21 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.431757:0:16414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607657.431763:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607657.431832:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+20:2396:x1876539130118016:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 171us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607657.431849:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607657.434389:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130117888 00000100:00100000:1.0:1789607657.434411:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130117888 00000100:00100000:1.0:1789607657.434563:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:1.0:1789607657.434576:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+20:15722:x1876539130117888:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:1.0:1789607657.434706:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434729:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434744:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434778:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434786:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434794:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434802:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607657.434807:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434815:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434827:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607657.434831:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607657.434836:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.434853:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbedcd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607657.435015:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+20:15722:x1876539130117888:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 441us (3837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607657.435023:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1789607657.439161:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.439253:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130118272 00000100:00100000:1.0:1789607657.439265:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130118272 00000100:00100000:1.0:1789607657.439366:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607657.439379:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+20:15722:x1876539130118272:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607657.439776:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+21:15722:x1876539130118272:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 398us (628us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789607657.439785:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000040:00080000:0.0:1789607657.573001:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607657.684787:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.684910:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130118528 00000100:00100000:2.0:1789607657.684935:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130118528 00000100:00100000:2.0:1789607657.685018:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:2.0:1789607657.685032:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+21:15753:x1876539130118528:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:2.0:1789607657.685065:0:16429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607657.685093:0:16429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedd4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668db6 expref: -99 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.685250:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbeddb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.685267:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbeddb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.685282:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbeddb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607657.685316:0:16429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789607657.685516:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbedd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668db6 expref: 24 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.685540:0:16429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbeddb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668db6 expref: 23 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.685549:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607657.685552:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607657.685556:0:16429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581400, rc 0) 00000100:00100000:2.0:1789607657.685638:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15753:x1876539130118528:12345-192.168.203.25@tcp:101:cat.0 Request processed in 611us (867us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789607657.685645:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:2.0:1789607657.693519:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.693603:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.693711:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130118912 00000100:00100000:1.0:1789607657.693725:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130118912 00000100:00100000:1.0:1789607657.693809:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:1.0:1789607657.693821:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+23:2396:x1876539130118912:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607657.693842:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607657.693903:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbeddb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668db6 expref: 23 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.693938:0:16415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607657.693945:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607657.694013:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+22:2396:x1876539130118912:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 194us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607657.694021:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1789607657.694921:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130118784 00000100:00100000:3.0:1789607657.694934:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130118784 00000100:00100000:3.0:1789607657.694986:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:3.0:1789607657.694997:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+22:15753:x1876539130118784:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:3.0:1789607657.698661:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15753:x1876539130118784:12345-192.168.203.25@tcp:35:cat.0 Request processed in 3652us (5144us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789607657.698672:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:0.0:1789607657.702306:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150121728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607657.702402:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607657.702781:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150121856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607657.702832:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607657.702891:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150121728 00000100:00100000:1.0:1789607657.702899:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150121728 00000100:00100000:1.0:1789607657.702954:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150121856 00000100:00100000:1.0:1789607657.702956:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150121856 00000100:00100000:1.0:1789607657.702976:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607657.702984:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150121728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607657.703028:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607657.703079:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150121728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607657.703086:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607657.703108:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607657.703113:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150121856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607657.703122:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607657.703298:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150121856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 184us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607657.703304:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789607657.703322:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607657.703362:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150121856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607657.703401:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150121728:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789607657.764525:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607657.796561:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607657.796751:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130119168 00000100:00100000:3.0:1789607657.796764:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130119168 00000100:00100000:3.0:1789607657.796836:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:3.0:1789607657.796848:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15759:x1876539130119168:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:3.0:1789607657.796910:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607657.796948:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbede9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dbd expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.797089:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.797108:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.797124:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607657.797162:0:16428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789607657.797371:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbede9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 26 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.797395:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 25 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607657.797405:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607657.797408:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607657.797412:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:3.0:1789607657.798285:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+25:15759:x1876539130119168:12345-192.168.203.25@tcp:101:dd.0 Request processed in 1435us (1734us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789607657.798296:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:2.0:1789607657.809504:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607657.809566:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.810183:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130119552 00000100:00100000:1.0:1789607657.810197:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130119552 00000100:00100000:1.0:1789607657.810261:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1789607657.810271:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+25:15759:x1876539130119552:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:1.0:1789607657.810344:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607657.810380:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeda3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668da1 expref: 25 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.810422:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607657.810430:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607657.810730:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.810748:0:16429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 25 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.810758:0:16429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.810801:0:16429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 25 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607657.810818:0:16429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 25 pid: 16428 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607657.810834:0:16429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16429:1876539150121984:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607657.810979:0:16429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607657.811202:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130119296 00000100:00100000:0.0:1789607657.811210:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130119296 00010000:00010000:0.0:1789607657.811239:0:16414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 26 pid: 16428 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607657.811274:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1789607657.811282:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+26:2396:x1876539130119296:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607657.811294:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607657.811300:0:16414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 26 pid: 16428 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.811313:0:16414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 26 pid: 16428 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.811330:0:16414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:0.0:1789607657.811334:0:16414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.811354:0:16414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.811361:0:16414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607657.811379:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607657.811411:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+26:2396:x1876539130119296:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 129us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607657.811419:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00010000:00010000:2.0:1789607657.816067:0:16429:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.25@tcp) returned -22 from blocking AST (req@000000007d0de6be x1876539150121984) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 25 pid: 16428 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.816100:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbedf0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dbd expref: 25 pid: 16428 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607657.816126:0:16429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16429:1876539150121984:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607657.816189:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607657.816200:0:16429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.816211:0:16429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.816217:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607657.816386:0:16429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789607657.816470:0:16429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1187149 reply state 000000008d1086d3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.816490:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607657.816498:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607657.816501:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607657.816505:0:16429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607657.816649:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+26:15759:x1876539130119552:12345-192.168.203.25@tcp:36:dd.0 Request processed in 6378us (7081us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789607657.816659:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000020:00080000:2.0:1789607657.816667:0:16429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607657.887441:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607657.888129:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130119808 00000100:00100000:1.0:1789607657.888144:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130119808 00000100:00100000:1.0:1789607657.888249:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:1.0:1789607657.888264:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+26:15759:x1876539130119808:12345-192.168.203.25@tcp:35:dd.0 00000100:00100000:1.0:1789607657.888604:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+27:15759:x1876539130119808:12345-192.168.203.25@tcp:35:dd.0 Request processed in 342us (1177us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1789607657.888611:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1789607658.123377:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.123547:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130119936 00000100:00100000:1.0:1789607658.123561:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130119936 00000100:00100000:1.0:1789607658.123650:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:1.0:1789607658.123662:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+27:15773:x1876539130119936:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:1.0:1789607658.123703:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.123729:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee05 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dc4 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.123812:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.123830:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.123845:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.123858:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.123896:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.123903:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124020:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124029:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124059:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607658.124103:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789607658.124108:0:16430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:0.0:1789607658.124460:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1789607658.124598:0:16430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124613:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124623:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124630:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124637:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124644:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.124649:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124657:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124672:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607658.124675:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.124692:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124717:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee0c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124734:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124740:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124747:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124752:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.124755:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124761:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124769:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d78d2475f00) 00010000:00010000:1.0:1789607658.124772:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.124775:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124781:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124817:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee05 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dc4 expref: 29 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124848:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dc4 expref: 28 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.124856:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607658.124859:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607658.124953:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76a00, rc 0) 00000100:00100000:1.0:1789607658.125044:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+28:15773:x1876539130119936:12345-192.168.203.25@tcp:101:stat.0 Request processed in 1384us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.125054:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:2.0:1789607658.189298:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.189428:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130120192 00000100:00100000:1.0:1789607658.189441:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130120192 00000100:00100000:1.0:1789607658.189517:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:1.0:1789607658.189529:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+28:15779:x1876539130120192:12345-192.168.203.25@tcp:36:truncate.0 00010000:00010000:1.0:1789607658.189600:0:17627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607658.189633:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dc4 expref: 28 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.189667:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607658.189673:0:17627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607658.189995:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.190014:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.190026:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607658.190114:0:17627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1789607658.190144:0:17627:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb6e1d51 reply state 00000000ce54ddef transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.190159:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.190166:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607658.190169:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607658.190172:0:17627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607658.190323:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+30:15779:x1876539130120192:12345-192.168.203.25@tcp:36:truncate.0 Request processed in 795us (1040us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789607658.190332:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000020:00080000:1.0:1789607658.190338:0:17627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789607658.402629:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607658.499410:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.501462:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130120320 00000100:00100000:3.0:1789607658.501482:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130120320 00000100:00100000:3.0:1789607658.501591:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:3.0:1789607658.501605:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+30:15793:x1876539130120320:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:3.0:1789607658.501641:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607658.501689:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbee28 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dcb expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.501784:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.501803:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.501839:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502498:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502509:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502519:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502643:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502731:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502740:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607658.502794:0:16428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1789607658.502800:0:16428:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607658.502831:0:16428:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502939:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502952:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502974:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502981:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.502987:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.502992:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503001:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503015:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:3.0:1789607658.503019:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.503025:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503032:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbee2f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503051:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503057:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503064:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503069:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.503079:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503086:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503095:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d78d2475f00) 00010000:00010000:3.0:1789607658.503097:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.503101:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503106:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbee36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503149:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbee28 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 32 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503166:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 31 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.503173:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607658.503175:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607658.503178:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184800, rc 0) 00000100:00100000:3.0:1789607658.503278:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+31:15793:x1876539130120320:12345-192.168.203.25@tcp:101:stat.0 Request processed in 1675us (3884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.503287:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1789607658.615478:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.615598:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130120576 00000100:00100000:1.0:1789607658.615612:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130120576 00000100:00100000:1.0:1789607658.615711:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:1.0:1789607658.615724:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+31:15803:x1876539130120576:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1789607658.615750:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.615780:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dd2 expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607658.615966:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607658.616129:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd2 expref: 33 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.616146:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:1.0:1789607658.616150:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607658.616173:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd2 expref: 33 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.616191:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76a00, rc 0) 00000100:00100000:1.0:1789607658.616276:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+32:15803:x1876539130120576:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 555us (813us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1789607658.616284:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:2.0:1789607658.628988:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.629158:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130120832 00000100:00100000:1.0:1789607658.629168:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130120832 00000100:00100000:1.0:1789607658.629226:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1789607658.629237:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c7b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+32:15803:x1876539130120832:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1789607658.629571:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c7b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+33:15803:x1876539130120832:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 334us (590us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789607658.629579:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1789607658.709447:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.711441:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121088 00000100:00100000:1.0:1789607658.711454:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121088 00000100:00100000:1.0:1789607658.711531:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:1.0:1789607658.711542:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+33:15809:x1876539130121088:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607658.711565:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.711585:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee52 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dd9 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711698:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711713:0:16430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 34 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711739:0:16430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 34 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711747:0:16430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711781:0:16430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 34 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711794:0:16430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 34 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.711807:0:16430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900eff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16430:1876539150122112:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607658.711913:0:16430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 34 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.711923:0:16430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 34 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.711931:0:16430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16430:1876539150122240:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607658.711952:0:16430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607658.717041:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.717092:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607658.717198:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121216 00000100:00100000:2.0:1789607658.717208:0:19178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121216 00010000:00010000:2.0:1789607658.717262:0:19178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 35 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.717302:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121344 00000100:00100000:2.0:1789607658.717306:0:19178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121344 00000100:00100000:3.0:1789607658.717315:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00010000:00010000:2.0:1789607658.717332:0:19178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 36 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607658.717343:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+36:2395:x1876539130121216:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607658.717360:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789607658.717363:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1789607658.717376:0:19178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+36:2395:x1876539130121344:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607658.717378:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 36 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.717390:0:19178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607658.717396:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 36 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.717398:0:19178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 36 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.717426:0:16415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607658.717431:0:16415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.717441:0:16415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.717448:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607658.717493:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+36:2395:x1876539130121216:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 167us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.717501:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00010000:00010000:2.0:1789607658.718284:0:19178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 35 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.718302:0:19178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.718306:0:19178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.718314:0:19178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.718321:0:19178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.718343:0:19178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607658.718383:0:19178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+35:2395:x1876539130121344:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1011us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.718401:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00010000:00010000:1.0:1789607658.718449:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbee3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dcb expref: 35 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.718467:0:16430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900eff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16430:1876539150122112:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607658.718488:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbed8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d9a expref: 33 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.718500:0:16430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16430:1876539150122240:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607658.718532:0:16430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.718542:0:16430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.718548:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607658.718566:0:16430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1789607658.718820:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee52 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 34 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.718835:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 33 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.718843:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607658.718846:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789607658.718848:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76600, rc 0) 00000100:00100000:1.0:1789607658.718919:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+33:15809:x1876539130121088:12345-192.168.203.25@tcp:101:bash.0 Request processed in 7378us (9479us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1789607658.718927:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:0.0:1789607658.722032:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.722359:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607658.722379:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150122368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607658.722444:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607658.722484:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607658.722493:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150122496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607658.722752:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607658.722792:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150122368 00000100:00100000:1.0:1789607658.722801:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150122368 00000100:00100000:1.0:1789607658.722838:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150122496 00000100:00100000:1.0:1789607658.722841:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150122496 00000100:00100000:1.0:1789607658.722855:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607658.722885:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150122368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607658.722922:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607658.723160:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607658.723169:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150122496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607658.723193:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607658.723232:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150122496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607658.723238:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607658.723288:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150122496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607658.723414:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150122368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 529us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.723421:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789607658.723754:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150122368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607658.723770:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121600 00000100:00100000:2.0:1789607658.723777:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121600 00000100:00100000:2.0:1789607658.723823:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1789607658.723841:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+33:15809:x1876539130121600:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:2.0:1789607658.724086:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.724103:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.724114:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607658.724165:0:16429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1789607658.724190:0:16429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032e97383 reply state 00000000d6197088 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.724201:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.724209:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.724212:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607658.724215:0:16429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607658.724292:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15809:x1876539130121600:12345-192.168.203.25@tcp:36:bash.0 Request processed in 461us (2269us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789607658.724298:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000020:00080000:2.0:1789607658.724301:0:16429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607658.726684:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.727096:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121728 00000100:00100000:0.0:1789607658.727105:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121728 00000100:00100000:0.0:1789607658.727176:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:0.0:1789607658.727185:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15809:x1876539130121728:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607658.727206:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607658.727226:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbee6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668de0 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.727282:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbee6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668de0 expref: 37 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.727297:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbee6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668de0 expref: 37 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.727315:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:0.0:1789607658.727318:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607658.727322:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075d600, rc 0) 00000100:00100000:0.0:1789607658.727388:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15809:x1876539130121728:12345-192.168.203.25@tcp:101:bash.0 Request processed in 203us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607658.727396:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:0.0:1789607658.741519:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.745044:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121856 00000100:00100000:1.0:1789607658.745058:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121856 00000100:00100000:1.0:1789607658.745131:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607658.745143:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15809:x1876539130121856:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607658.745167:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.745188:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee75 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668de7 expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.745289:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.745303:0:17627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 38 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.745321:0:17627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.745367:0:17627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 38 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.745380:0:17627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 38 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.745393:0:17627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17627:1876539150122624:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607658.745484:0:17627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607658.749646:0:17627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17627:1876539150122624:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607658.749674:0:17627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607658.751573:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.754456:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130121984 00000100:00100000:3.0:1789607658.754470:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130121984 00010000:00010000:3.0:1789607658.754590:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 39 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607658.754769:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1789607658.754781:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+39:2395:x1876539130121984:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607658.754797:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607658.754806:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 39 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.754836:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 39 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.754906:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76600/0xa26202d240fbee59 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dd9 expref: 39 pid: 16430 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.754925:0:16415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607658.754930:0:16415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.754939:0:16415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.754945:0:16415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.754977:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607658.755040:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+38:2395:x1876539130121984:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 261us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.755047:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00010000:00010000:1.0:1789607658.755108:0:17627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.755117:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607658.755163:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789607658.755167:0:17627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607658.755188:0:17627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.755217:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee75 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668de7 expref: 38 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.755246:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668de7 expref: 37 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.755253:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607658.755255:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607658.755258:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76400, rc 0) 00000100:00100000:1.0:1789607658.755284:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15809:x1876539130121856:12345-192.168.203.25@tcp:101:bash.0 Request processed in 10143us (13783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.755292:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:0.0:1789607658.770326:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607658.771774:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130122240 00000100:00100000:2.0:1789607658.771799:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130122240 00000100:00100000:2.0:1789607658.772007:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1789607658.772020:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15809:x1876539130122240:12345-192.168.203.25@tcp:103:bash.0 00010000:00010000:2.0:1789607658.772037:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789607658.772062:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76400/0xa26202d240fbee7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668de7 expref: 37 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.772085:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbee6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668de0 expref: 36 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.772096:0:16414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.772102:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607658.772148:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+35:15809:x1876539130122240:12345-192.168.203.25@tcp:103:bash.0 Request processed in 132us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.772156:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1789607658.777266:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.777432:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130122368 00000100:00100000:0.0:1789607658.777441:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130122368 00000100:00100000:0.0:1789607658.777489:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1789607658.777499:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+35:15809:x1876539130122368:12345-192.168.203.25@tcp:58:bash.0 00010000:00010000:0.0:1789607658.777607:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.777631:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.777642:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607658.778845:0:16428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607658.779181:0:16428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789607658.779247:0:16428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789607658.779492:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+35:15809:x1876539130122368:12345-192.168.203.25@tcp:58:bash.0 Request processed in 1988us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607658.779503:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1789607658.781779:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607658.783238:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130122496 00000100:00100000:2.0:1789607658.783251:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130122496 00000100:00100000:2.0:1789607658.783647:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:2.0:1789607658.783660:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+35:15809:x1876539130122496:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1789607658.783691:0:16429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607658.783712:0:16429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dee expref: -99 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.783769:0:16429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.783781:0:16429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 36 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.783811:0:16429:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.783825:0:16429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 36 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.783838:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.783840:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607658.783844:0:16429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 36 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.783851:0:16429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581600, rc 0) 00000100:00100000:2.0:1789607658.784343:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15809:x1876539130122496:12345-192.168.203.25@tcp:101:bash.0 Request processed in 685us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.784352:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000040:00080000:0.0:1789607658.786161:0:16464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789607658.786169:0:16464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607658.786204:0:16464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789607658.786211:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789607658.786319:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:16464:1876539150122752:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607658.786409:0:16464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607658.792096:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:16464:1876539150122752:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607658.792789:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.796108:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130122624 00000100:00100000:1.0:1789607658.796122:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130122624 00000100:00100000:1.0:1789607658.796234:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:1.0:1789607658.796245:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15810:x1876539130122624:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789607658.796281:0:16430:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789607658.796403:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15810:x1876539130122624:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 159us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.796411:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1789607658.805765:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.805984:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130122752 00000100:00100000:1.0:1789607658.805999:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130122752 00000100:00100000:1.0:1789607658.806064:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607658.806074:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15810:x1876539130122752:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789607658.806150:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806168:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806193:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806209:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806215:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806221:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806243:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806251:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806257:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607658.806295:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789607658.806299:0:17627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607658.806313:0:17627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806323:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806342:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806358:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806364:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.806368:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806376:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806386:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c73e1100) 00010000:00010000:1.0:1789607658.806389:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.806393:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806399:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbee91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806414:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806419:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806426:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806430:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.806433:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806448:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806456:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d78d2475c00) 00010000:00010000:1.0:1789607658.806458:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.806461:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806467:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbee98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806480:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806486:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806491:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806495:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.806498:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806503:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806509:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:1.0:1789607658.806511:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.806514:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.806529:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbee9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.806607:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15810:x1876539130122752:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 534us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.806615:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:2.0:1789607658.811954:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.812034:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130123008 00000100:00100000:0.0:1789607658.812113:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130123008 00000100:00100000:0.0:1789607658.812170:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:0.0:1789607658.812180:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+36:15810:x1876539130123008:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607658.812205:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607658.812225:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbeea6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668df5 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812403:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812419:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812431:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607658.812443:0:16428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789607658.812537:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812545:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812551:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812557:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607658.812561:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812568:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812580:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:0.0:1789607658.812583:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607658.812588:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812604:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbeead lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812645:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbeea6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668df5 expref: 38 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812656:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c73e1100) 00010000:00010000:0.0:1789607658.812658:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607658.812662:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbeea6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668df5 expref: 38 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.812672:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c400, rc 0) 00000100:00100000:0.0:1789607658.814412:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15810:x1876539130123008:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 2224us (2458us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1789607658.814424:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:0.0:1789607658.823515:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.823732:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130123136 00000100:00100000:1.0:1789607658.823743:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130123136 00000100:00100000:1.0:1789607658.823809:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:1.0:1789607658.823820:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15810:x1876539130123136:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789607658.823896:0:17627:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789607658.824017:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15810:x1876539130123136:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 198us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.824024:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:2.0:1789607658.834052:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.834139:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130123392 00000100:00100000:1.0:1789607658.834148:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130123392 00000100:00100000:1.0:1789607658.834208:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1789607658.834218:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+37:15810:x1876539130123392:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607658.834239:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.834260:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbeebb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668dfc expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607658.834851:0:16430:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1789607658.834970:0:16430:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789607658.835024:0:16430:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789607658.835292:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbeec2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.835315:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.835327:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.835391:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77200/0xa26202d240fbeebb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dfc expref: 40 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.835409:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbeec2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dfc expref: 39 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.835417:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d2475c00) 00010000:00010000:1.0:1789607658.835420:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607658.835423:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77800, rc 0) 00000100:00100000:1.0:1789607658.835477:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+39:15810:x1876539130123392:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1260us (1434us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789607658.835485:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1789607658.839464:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.843228:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130123648 00000100:00100000:1.0:1789607658.843245:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130123648 00000100:00100000:1.0:1789607658.843321:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607658.843332:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+39:15810:x1876539130123648:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607658.843387:0:17627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607658.843413:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbeec2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dfc expref: 39 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843432:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d2475c00) 00010000:00010000:1.0:1789607658.843455:0:17627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607658.843478:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843490:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843499:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843557:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843565:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843572:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843632:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843640:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843645:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843651:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.843654:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843661:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843687:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:1.0:1789607658.843690:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.843694:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843700:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeed0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843709:0:17627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843715:0:17627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843720:0:17627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843725:0:17627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607658.843728:0:17627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843733:0:17627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843741:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfc977007 (ffff8d78d2475600) 00010000:00010000:1.0:1789607658.843743:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607658.843746:0:17627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.843751:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77e00/0xa26202d240fbeed7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfc977007 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.843840:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+38:15810:x1876539130123648:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 510us (4384us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607658.843847:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:0.0:1789607658.846848:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.847126:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130123776 00000100:00100000:3.0:1789607658.847135:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130123776 00000100:00100000:3.0:1789607658.847185:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:3.0:1789607658.847195:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+38:15810:x1876539130123776:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607658.847214:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607658.847250:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeede lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e03 expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.847285:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbeee5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.847298:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.847309:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbeee5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.847406:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeede lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e03 expref: 40 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.847423:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbeee5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e03 expref: 39 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.847431:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607658.847434:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789607658.847437:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9184a00, rc 0) 00000100:00100000:3.0:1789607658.847495:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+39:15810:x1876539130123776:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 302us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.847502:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:0.0:1789607658.854368:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.855200:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130124032 00000100:00100000:1.0:1789607658.855211:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130124032 00000100:00100000:2.0:1789607658.855420:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:2.0:1789607658.855432:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+39:15810:x1876539130124032:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789607658.855515:0:17627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.855532:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.855545:0:17627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607658.858287:0:17627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789607658.858308:0:17627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 563815445406ns, next at 564815441860ns, rc = 0 00000004:00010000:2.0:1789607658.858414:0:17627:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008be56057 reply state 00000000c9776eec transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.858434:0:17627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.858443:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607658.858446:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789607658.858451:0:17627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607658.858572:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+41:15810:x1876539130124032:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 3138us (4209us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789607658.858581:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1789607658.862592:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.862741:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130124160 00000100:00100000:3.0:1789607658.862751:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130124160 00000100:00100000:3.0:1789607658.862826:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:3.0:1789607658.862845:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+41:15810:x1876539130124160:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607658.862885:0:16428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607658.862928:0:16428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e0a expref: -99 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.862998:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 42 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.863012:0:16428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 42 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.863032:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607658.863035:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607658.863039:0:16428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c9185800, rc 0) 00000100:00100000:3.0:1789607658.863094:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+42:15810:x1876539130124160:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 251us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.863100:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:0.0:1789607658.866464:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607658.866542:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130124288 00000100:00100000:2.0:1789607658.866552:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130124288 00000100:00100000:2.0:1789607658.866621:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:2.0:1789607658.866636:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2396:x1876539130124288:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789607658.867295:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2396:x1876539130124288:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 663us (838us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789607658.867303:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00080000:0.0:1789607658.867775:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607658.870788:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.870901:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130124544 00000100:00100000:3.0:1789607658.870911:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130124544 00000100:00100000:3.0:1789607658.870983:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1789607658.870995:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+42:15810:x1876539130124544:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607658.871213:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+43:15810:x1876539130124544:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 220us (432us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789607658.871221:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:1.0:1789607658.875565:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.875666:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130124800 00000100:00100000:3.0:1789607658.875685:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130124800 00000100:00100000:3.0:1789607658.875745:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1789607658.875756:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+43:15810:x1876539130124800:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607658.875901:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+43:15810:x1876539130124800:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.875934:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:0.0:1789607658.878518:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.878606:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130124928 00000100:00100000:1.0:1789607658.878615:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130124928 00000100:00100000:1.0:1789607658.878674:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:1.0:1789607658.878693:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+43:15810:x1876539130124928:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607658.878711:0:16430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.878733:0:16430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeefa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e11 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.878798:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbef01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.878811:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbef01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.878821:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbef01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607658.878892:0:16430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607658.878924:0:16430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbef01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.878949:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76a00/0xa26202d240fbeefa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e11 expref: 45 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.878985:0:16430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbef01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e11 expref: 44 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.878993:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:1.0:1789607658.878995:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789607658.878999:0:16430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77800, rc 0) 00000100:00100000:1.0:1789607658.879048:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+44:15810:x1876539130124928:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 357us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.879055:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:0.0:1789607658.882246:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.882318:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130125056 00000100:00100000:1.0:1789607658.882327:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130125056 00000100:00100000:1.0:1789607658.882382:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:1.0:1789607658.882391:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2395:x1876539130125056:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607658.882408:0:17739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.882430:0:17739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e18 expref: -99 pid: 17739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607658.882454:0:17739:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3eeb, blocks: 0x1 00010000:00010000:1.0:1789607658.882472:0:17739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=563s v=(0 0) 00010000:00010000:1.0:1789607658.882477:0:17739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607658.882485:0:17739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 7 pid: 17739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.882506:0:17739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 7 pid: 17739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.882536:0:17739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77200, rc 0) 00000100:00100000:1.0:1789607658.882598:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+7:2395:x1876539130125056:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 207us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.882605:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1789607658.885541:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.885622:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130125312 00000100:00100000:3.0:1789607658.885632:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130125312 00000100:00100000:3.0:1789607658.885699:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:3.0:1789607658.885709:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+44:15810:x1876539130125312:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607658.885811:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+44:15810:x1876539130125312:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.885818:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:2.0:1789607658.888175:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.888258:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130125440 00000100:00100000:1.0:1789607658.888268:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130125440 00000100:00100000:1.0:1789607658.888325:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:1.0:1789607658.888335:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+44:15810:x1876539130125440:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789607658.933063:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+44:15810:x1876539130125440:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 44719us (44886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607658.933091:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000001:00080000:2.0:1789607658.934284:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:2.0:1789607658.934304:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1789607658.934340:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1789607658.934352:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1789607658.934356:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789607658.934393:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:2.0:1789607658.934521:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150122880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789607658.934571:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607658.934620:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150122880 00000100:00100000:2.0:1789607658.934627:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150122880 00010000:00010000:3.0:1789607658.934771:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934782:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934789:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934795:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.934800:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934806:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934821:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d78c6f8c500) 00010000:00010000:3.0:1789607658.934824:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.934839:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934854:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580200/0xa26202d240fbecd8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934906:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934913:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934918:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934923:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.934926:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934931:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934939:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:3.0:1789607658.934942:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.934945:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934951:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbecdf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934973:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934980:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.934998:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935003:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.935007:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935014:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935025:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d78d2475f00) 00010000:00010000:3.0:1789607658.935027:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.935031:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935037:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76000/0xa26202d240fbed87 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935054:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935060:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935065:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935070:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.935073:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935088:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935097:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607658.935099:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.935102:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935108:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76200/0xa26202d240fbedfe lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935120:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935125:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935131:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935135:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.935138:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935143:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935150:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607658.935153:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.935155:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935170:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76800/0xa26202d240fbee21 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935183:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935188:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935194:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935200:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.935203:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935208:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935216:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:3.0:1789607658.935218:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607658.935221:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935227:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581a00/0xa26202d240fbee67 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935238:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935244:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935256:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935261:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607658.935264:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935270:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935278:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607658.935281:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789607658.935283:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.935289:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581e00/0xa26202d240fbeeec lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.936145:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607658.936160:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150122880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789607658.936331:0:17881:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789607658.936335:0:17881:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789607658.936337:0:17881:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789607658.936339:0:17881:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789607659 -> 1789607659 00002000:00010000:2.0:1789607658.936342:0:17881:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789607658.936426:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3471:x1876539150122880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 270us (1852us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789607658.936434:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789607658.936459:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789607658.936701:0:3471:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7900a54000/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789607658.936708:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150122880:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789607658.936919:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.936929:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.936935:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.936941:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607658.936945:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.936953:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.937139:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:0.0:1789607658.937142:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789607658.937147:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.937154:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77c00/0xa26202d240fbed2c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607658.937414:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.937579:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130125568 00000100:00100000:1.0:1789607658.937587:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130125568 00000100:00100000:1.0:1789607658.937630:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:1.0:1789607658.937639:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+7:2396:x1876539130125568:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789607658.937838:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+7:2396:x1876539130125568:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 199us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.937845:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:1.0:1789607658.946096:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.946175:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130125824 00000100:00100000:3.0:1789607658.946185:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130125824 00000100:00100000:3.0:1789607658.946290:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:3.0:1789607658.946303:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+13:15810:x1876539130125824:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607658.946354:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607658.946378:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77800/0xa26202d240fbef01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e11 expref: 13 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.946397:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607658.946401:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607658.946443:0:16429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.946456:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.946467:0:16429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607658.946729:0:16429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9698a8d reply state 00000000885ffd61 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.946742:0:16429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.946749:0:16429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:3.0:1789607658.946752:0:16429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607658.946754:0:16429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607658.946886:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+14:15810:x1876539130125824:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 558us (770us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789607658.946894:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:2.0:1789607658.949714:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.949794:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130125952 00000100:00100000:1.0:1789607658.949803:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130125952 00000100:00100000:1.0:1789607658.950023:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:1.0:1789607658.950034:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15810:x1876539130125952:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607658.950050:0:17881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607658.950077:0:17881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e1f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.950107:0:17881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 8 pid: 17739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.950115:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607658.950120:0:17881:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607658.950125:0:17881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 8 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.950156:0:17881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 8 pid: 17739 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.950170:0:17881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 8 pid: 17739 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.950183:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17881:1876539150123008:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607658.950264:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607658.953324:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.953393:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126080 00000100:00100000:0.0:1789607658.953402:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126080 00010000:00010000:0.0:1789607658.953438:0:16416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 9 pid: 17739 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607658.953495:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607658.953503:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+9:2396:x1876539130126080:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607658.953517:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607658.953538:0:16416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 9 pid: 17739 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.953549:0:16416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 9 pid: 17739 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.953574:0:16416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607658.953579:0:16416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607658.953586:0:16416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 9 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.953596:0:16416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 9 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.953631:0:16416:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 9 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607658.953644:0:16416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:16416:1876539150123136:192.168.203.25@tcp:105: 00000100:00100000:0.0:1789607658.953745:0:16416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2780 going to sleep for 11 seconds 00010000:00010000:2.0:1789607658.954362:0:17881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ae7b067/0xa26202d240fbef08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e18 expref: 9 pid: 17739 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.954377:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7900efea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17881:1876539150123008:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607658.954400:0:17881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 8 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.954410:0:17881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77400, rc 0) 00000100:00100000:2.0:1789607658.954455:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+8:15810:x1876539130125952:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 4424us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.954471:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:1.0:1789607658.958578:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.958704:0:16416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:16416:1876539150123136:192.168.203.25@tcp:105: 00010000:00010000:0.0:1789607658.958739:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607658.958789:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+7:2396:x1876539130126080:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 5286us (5473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607658.958798:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1789607658.959069:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126208 00000100:00100000:2.0:1789607658.959076:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126208 00000100:00100000:2.0:1789607658.959116:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:2.0:1789607658.959125:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+7:2395:x1876539130126208:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789607658.959294:0:17737:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789607658.959297:0:17737:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789607659 00002000:00010000:2.0:1789607658.959300:0:17737:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789607658 00002000:00010000:2.0:1789607658.959302:0:17737:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789607659 -> 1789607659 00002000:00010000:2.0:1789607658.959303:0:17737:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789607658.959327:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+8:2395:x1876539130126208:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 203us (757us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789607658.959333:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:1.0:1789607658.962046:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.962131:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126336 00000100:00100000:3.0:1789607658.962141:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126336 00000100:00100000:3.0:1789607658.962193:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:3.0:1789607658.962203:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+8:2393:x1876539130126336:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789607658.962246:0:17740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.962267:0:17740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 8 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.962295:0:17740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607658.962299:0:17740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607658.962304:0:17740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.962338:0:17740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 8 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.962352:0:17740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 8 pid: 17881 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607658.962366:0:17740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:17740:1876539150123264:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607658.962519:0:17740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607658.966359:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607658.966430:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126464 00000100:00100000:1.0:1789607658.966439:0:19178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126464 00010000:00010000:1.0:1789607658.966478:0:19178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 9 pid: 17881 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607658.966537:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:1.0:1789607658.966547:0:19178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+9:2395:x1876539130126464:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607658.966562:0:19178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607658.966583:0:19178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 9 pid: 17881 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.966597:0:19178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 9 pid: 17881 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.966621:0:19178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607658.966625:0:19178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607658.966630:0:19178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.966639:0:19178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607658.966664:0:19178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607658.966728:0:19178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+9:2395:x1876539130126464:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 182us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607658.966735:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00010000:00010000:3.0:1789607658.968141:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098cfff8f/0xa26202d240fbef16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e1f expref: 8 pid: 17881 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607658.968162:0:17740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:17740:1876539150123264:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607658.968187:0:17740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968304:0:17740:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968313:0:17740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968342:0:17740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968350:0:17740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968376:0:17740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968384:0:17740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607658.968388:0:17740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968397:0:17740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968413:0:17740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.968420:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfe1d441/0xa26202d240fbef1d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.968535:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f075d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+7:2393:x1876539130126336:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 6332us (6495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.968543:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1789607658.971261:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.971328:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126720 00000100:00100000:3.0:1789607658.971337:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126720 00000100:00100000:3.0:1789607658.971427:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:3.0:1789607658.971437:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+14:15810:x1876539130126720:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607658.971528:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971545:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971557:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971802:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971814:0:16428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 15 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971823:0:16428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971907:0:16428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 15 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.971930:0:16428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 15 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607658.971943:0:16428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16428:1876539150123392:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607658.972013:0:16428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd1d2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607658.975722:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607658.975801:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126848 00000100:00100000:2.0:1789607658.975810:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126848 00010000:00010000:2.0:1789607658.975891:0:16415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 16 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.975933:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1789607658.975955:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+16:2396:x1876539130126848:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607658.975970:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607658.975977:0:16415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 16 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.975989:0:16415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 16 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.976011:0:16415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607658.976016:0:16415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.976025:0:16415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.976033:0:16415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.976052:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607658.976101:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+16:2396:x1876539130126848:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 148us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.976108:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00010000:00010000:3.0:1789607658.977125:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185800/0xa26202d240fbeef3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e0a expref: 15 pid: 16428 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607658.977167:0:16428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16428:1876539150123392:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607658.977187:0:16428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.977196:0:16428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607658.977201:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607658.977377:0:16428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789607658.977510:0:16428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789607658.977550:0:16428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789607658.977620:0:16428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16428:1876539150123520:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789607658.978241:0:16428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607658.978275:0:16428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0ef8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789607658.978331:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150123520 00000100:00100000:0.0:1789607658.978341:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150123520 00000100:00100000:0.0:1789607658.978390:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789607658.978399:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:16428:x1876539150123520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789607658.978478:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:16428:x1876539150123520:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607658.978485:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789607658.978580:0:16428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16428:1876539150123520:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789607658.979411:0:16428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1789607658.979495:0:16428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16428:1876539150123648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789607658.979537:0:16428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607658.979568:0:16428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607658.979821:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150123648 00000100:00100000:0.0:1789607658.979828:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150123648 00000100:00100000:0.0:1789607658.979888:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789607658.979896:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16428:x1876539150123648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789607658.980063:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16428:x1876539150123648:12345-0@lo:1000:mdt00_000.0 Request processed in 167us (524us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789607658.980070:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607658.980404:0:16428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16428:1876539150123648:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789607658.980444:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980454:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980462:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980468:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607658.980472:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980480:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980494:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607658.980497:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607658.980501:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980508:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77c571e000/0xa26202d240fbef2b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980537:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980543:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980548:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980562:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075de00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607658.980566:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980572:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980581:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.980583:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607658.980590:0:16428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 18 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980600:0:16428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 18 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980609:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 18 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.980637:0:16428:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 18 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.980648:0:16428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16428:1876539150123776:192.168.203.25@tcp:105: 00000100:00100000:2.0:1789607658.980738:0:16428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607658.984414:0:16428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16428:1876539150123776:192.168.203.25@tcp:105: 00010000:00010000:2.0:1789607658.984448:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984473:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075de00/0xa26202d240fbee83 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984504:0:16428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984517:0:16428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984528:0:16428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984539:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984546:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984552:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984557:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607658.984560:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984568:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984579:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.984581:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607658.984585:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984598:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580e00/0xa26202d240fbef32 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984608:0:16428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984614:0:16428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984619:0:16428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984625:0:16428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607658.984627:0:16428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984633:0:16428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984641:0:16428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607658.984644:0:16428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607658.984646:0:16428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.984652:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184800/0xa26202d240fbef24 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16428 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607658.985058:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+18:15810:x1876539130126720:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 13621us (13805us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789607658.985068:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000020:00080000:2.0:1789607658.985079:0:16428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789607658.985438:0:16464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789607658.985443:0:16464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607658.985482:0:16464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789607658.985489:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789607658.986714:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607658.986786:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130126976 00000100:00100000:3.0:1789607658.986796:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130126976 00000100:00100000:3.0:1789607658.986854:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1789607658.986901:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+18:15809:x1876539130126976:12345-192.168.203.25@tcp:49:bash.0 00000100:00100000:3.0:1789607658.987027:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+18:15809:x1876539130126976:12345-192.168.203.25@tcp:49:bash.0 Request processed in 129us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607658.987035:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1789607658.990043:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607658.990125:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130127232 00000100:00100000:0.0:1789607658.990135:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130127232 00000100:00100000:0.0:1789607658.990199:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1789607658.990213:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+18:15810:x1876539130127232:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789607658.990909:0:16431:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789607658.991015:0:16431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1789607658.991056:0:16431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.991073:0:16431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.991084:0:16431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.991093:0:16431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.991099:0:16431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.991105:0:16431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607658.991125:0:16431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789607658.991205:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+20:15810:x1876539130127232:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 992us (1169us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1789607658.991214:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000020:00080000:0.0:1789607658.991218:0:16431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789607658.991496:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607658.991504:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.991513:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607658.991517:0:16417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.991525:0:16417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.991539:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607658.991542:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789607658.991547:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.991553:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.991566:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607658.991568:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607658.991570:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607658.996529:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607658.996597:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130127360 00000100:00100000:2.0:1789607658.996607:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130127360 00000100:00100000:2.0:1789607658.996670:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1789607658.996691:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+7:15809:x1876539130127360:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1789607658.996709:0:17737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607658.996729:0:17737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbef40 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e26 expref: -99 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607658.996773:0:17737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aab3eeb, atime: 0x6aab3eea, ctime: 0x6aab3eeb, blocks: 0x1 00010000:00010000:2.0:1789607658.996797:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1789607658.996801:0:17737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607658.996810:0:17737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbef40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e26 expref: 8 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.996826:0:17737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbef40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e26 expref: 8 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607658.996837:0:17737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd580e00, rc 0) 00000100:00100000:2.0:1789607658.997112:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+8:15809:x1876539130127360:12345-192.168.203.25@tcp:101:bash.0 Request processed in 433us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607658.997120:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:3.0:1789607659.000534:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607659.000622:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130127616 00000100:00100000:0.0:1789607659.000632:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130127616 00000100:00100000:0.0:1789607659.000705:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:0.0:1789607659.000728:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+20:15809:x1876539130127616:12345-192.168.203.25@tcp:35:bash.0 00000001:00080000:0.0:1789607659.001408:0:16431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1789607659.001516:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+22:15809:x1876539130127616:12345-192.168.203.25@tcp:35:bash.0 Request processed in 788us (990us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1789607659.001523:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000020:00080000:0.0:1789607659.001528:0:16431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607659.081908:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607659.082152:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130127872 00000100:00100000:2.0:1789607659.082162:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130127872 00000100:00100000:2.0:1789607659.082223:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:2.0:1789607659.082234:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+22:15820:x1876539130127872:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607659.082256:0:17627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607659.082277:0:17627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbef47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e2d expref: -99 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607659.082378:0:17627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607659.082494:0:17627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbef47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e2d expref: 24 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607659.082518:0:17627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:2.0:1789607659.082521:0:17627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607659.082526:0:17627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581400/0xa26202d240fbef47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e2d expref: 24 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607659.082540:0:17627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd581400, rc 0) 00000100:00100000:2.0:1789607659.082599:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15820:x1876539130127872:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 368us (749us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1789607659.082607:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:2.0:1789607659.087239:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607659.087332:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128000 00000100:00100000:0.0:1789607659.087341:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128000 00000100:00100000:0.0:1789607659.087429:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1789607659.087439:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15820:x1876539130128000:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1789607659.087506:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087522:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087536:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087551:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087559:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087566:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087813:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087846:0:16430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087853:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607659.087937:0:16430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087951:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087957:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087964:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087969:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607659.087973:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087980:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.087991:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:0.0:1789607659.087994:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607659.087999:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088004:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c400/0xa26202d240fbef55 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088022:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088028:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088034:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088039:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607659.088042:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088047:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088056:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d78c73e1b00) 00010000:00010000:0.0:1789607659.088058:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607659.088061:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088066:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c000/0xa26202d240fbef5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088079:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088085:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088089:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088100:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607659.088103:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088109:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088115:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:0.0:1789607659.088118:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607659.088121:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607659.088126:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d600/0xa26202d240fbef63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607659.088204:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15820:x1876539130128000:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 766us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.088213:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1789607659.090499:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607659.090570:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128256 00000100:00100000:3.0:1789607659.090580:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128256 00000100:00100000:3.0:1789607659.090632:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1789607659.090643:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+23:15820:x1876539130128256:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607659.090938:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+24:15820:x1876539130128256:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 296us (446us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1789607659.090946:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1789607659.234125:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607659.234146:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150123904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607659.234220:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.234311:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150123904 00000100:00100000:0.0:1789607659.234319:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150123904 00000100:00100000:0.0:1789607659.234372:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607659.234382:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150123904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607659.234415:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607659.234460:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150123904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.234466:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607659.234612:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150123904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607659.234632:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150124032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607659.234658:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607659.234886:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124032 00000100:00100000:3.0:1789607659.234891:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124032 00000100:00100000:3.0:1789607659.234937:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607659.234953:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150124032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607659.234969:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607659.235006:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150124032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607659.235013:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789607659.235168:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607659.235198:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150124032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607659.236354:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150124544:0@lo:400:kworker.0 00000100:00100000:1.0:1789607659.236395:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150124160:0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.236419:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607659.236439:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.236477:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124160 00000100:00100000:1.0:1789607659.236491:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150124672:0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.236493:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124160 00000100:00100000:1.0:1789607659.236527:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.236541:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789607659.236552:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150125184:0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.236554:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3470:x1876539150124160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607659.236584:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150124416:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.236759:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124672 00000100:00100000:3.0:1789607659.236764:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124672 00000100:00100000:3.0:1789607659.236791:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607659.236803:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.239298:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3470:x1876539150124160:12345-0@lo:400:kworker.0 Request processed in 2740us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.239312:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789607659.239361:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150124288:0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.239577:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124544 00000100:00100000:3.0:1789607659.239582:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.239586:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124544 00000100:00100000:3.0:1789607659.239613:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150124800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.239625:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607659.239633:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150124544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.239652:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607659.239671:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150125312:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.239709:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.239751:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150124544:12345-0@lo:400:kworker.0 Request processed in 118us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.239758:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607659.239764:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150124672:12345-0@lo:400:kworker.0 Request processed in 2967us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.239769:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125312 00000100:00100000:3.0:1789607659.239771:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607659.239772:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125312 00000100:00100000:3.0:1789607659.239784:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124288 00000100:00100000:3.0:1789607659.239787:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124288 00000100:00100000:3.0:1789607659.239806:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607659.239812:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150124288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.239848:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150124288:12345-0@lo:400:kworker.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607659.239854:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789607659.239904:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124800 00000100:00100000:3.0:1789607659.239909:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150124288:0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.239922:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124800 00000100:00100000:0.0:1789607659.239938:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789607659.239947:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.239965:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789607659.239980:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150124544:0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.239982:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150124800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.239990:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150125056:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.240022:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.240062:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150125312:12345-0@lo:400:kworker.0 Request processed in 118us (352us total) trans 0 rc 0/0 00000100:00080000:3.0:1789607659.240063:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607659.240067:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607659.240070:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607659.240078:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125056 00000100:00100000:3.0:1789607659.240081:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125056 00000100:00100000:1.0:1789607659.240098:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607659.240113:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607659.240119:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150125056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607659.240135:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150124928:0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.240154:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150124800:12345-0@lo:400:kworker.0 Request processed in 180us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607659.240164:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789607659.240170:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150125056:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607659.240181:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789607659.240181:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607659.240201:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124928 00000100:00100000:3.0:1789607659.240205:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124928 00000100:00100000:1.0:1789607659.240211:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150125440:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.240226:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789607659.240229:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150124416 00000100:00100000:3.0:1789607659.240235:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150124928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.240235:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150124416 00000100:00100000:2.0:1789607659.240267:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607659.240277:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.240411:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607659.240643:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607659.240651:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150124416:12345-0@lo:400:kworker.0 Request processed in 375us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607659.240660:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607659.240684:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150124928:12345-0@lo:400:kworker.0 Request processed in 442us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607659.240692:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607659.240705:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125184 00000100:00100000:3.0:1789607659.240708:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125184 00000100:00100000:3.0:1789607659.240729:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125440 00000100:00100000:3.0:1789607659.240731:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125440 00000100:00100000:0.0:1789607659.240736:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150124160:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.240745:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607659.240749:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150124672:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.240750:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150125184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.240782:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789607659.240788:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150125184:12345-0@lo:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.240791:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150125440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.240795:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789607659.240813:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607659.240817:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607659.240819:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607659.240844:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150124800:0@lo:400:kworker.0 00000100:00100000:3.0:1789607659.240846:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150125056:0@lo:400:kworker.0 00000100:00100000:2.0:1789607659.240888:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150125312:0@lo:400:kworker.0 00000100:00100000:1.0:1789607659.240904:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150124416:0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.240916:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150125440:12345-0@lo:400:kworker.0 Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607659.240920:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150124928:0@lo:400:kworker.0 00000100:00100000:0.0:1789607659.240931:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789607659.241033:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fce7ca80 x1876539150125184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607659.241044:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150125184:0@lo:400:kworker.0 00010000:00080000:1.0:1789607659.241570:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fce7ce00 x1876539150125440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607659.241580:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150125440:0@lo:400:kworker.0 00010000:00010000:3.0:1789607659.426297:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607659.622963:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1789607659.812246:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1789607659.812391:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:2.0:1789607660.451998:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607660.566184:0:19331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789607661.474063:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607662.085465:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085503:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085533:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085558:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085582:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085598:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085614:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085630:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085662:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607662.085689:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128768 00000100:00100000:3.0:1789607662.085693:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128512 00000100:00100000:3.0:1789607662.085703:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128512 00000100:00100000:2.0:1789607662.085705:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128768 00000100:00100000:2.0:1789607662.085766:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129280 00000100:00100000:3.0:1789607662.085767:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129024 00000100:00100000:2.0:1789607662.085770:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129280 00000100:00100000:3.0:1789607662.085773:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129024 00000100:00100000:2.0:1789607662.085792:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128896 00000100:00100000:2.0:1789607662.085796:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128896 00000100:00100000:2.0:1789607662.085822:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129408 00000100:00100000:2.0:1789607662.085825:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129408 00000100:00100000:2.0:1789607662.085846:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:3.0:1789607662.085857:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128640 00000100:00100000:2.0:1789607662.085858:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130128768:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607662.085947:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130128768:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 93us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607662.085954:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:2.0:1789607662.085970:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607662.085977:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130129280:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607662.085998:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130129280:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607662.086005:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607662.086015:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:2.0:1789607662.086022:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2393:x1876539130128896:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607662.086045:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2393:x1876539130128896:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607662.086051:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:2.0:1789607662.086062:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:2.0:1789607662.086068:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130129408:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607662.086089:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130129408:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607662.086102:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1789607662.086185:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128640 00000100:00100000:3.0:1789607662.086208:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129152 00000100:00100000:3.0:1789607662.086211:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129152 00000100:00100000:3.0:1789607662.086232:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:3.0:1789607662.086241:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+24:2393:x1876539130128512:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607662.086312:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1789607662.086323:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2393:x1876539130129024:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607662.086344:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+24:2393:x1876539130128512:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 102us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607662.086352:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607662.086357:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2393:x1876539130129024:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 35us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607662.086365:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:3.0:1789607662.086374:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:3.0:1789607662.086384:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130128640:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607662.086390:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:1.0:1789607662.086400:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130129152:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607662.086418:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130128640:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607662.086425:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:1.0:1789607662.086436:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130129152:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607662.086447:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130128384 00000100:00100000:1.0:1789607662.086452:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:3.0:1789607662.086453:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130128384 00000100:00100000:3.0:1789607662.086485:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00100000:3.0:1789607662.086493:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130128384:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607662.086518:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130128384:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607662.086523:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00080000:3.0:1789607662.086548:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607662.086552:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607662.086554:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607662.086556:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 42625 lines, 42625 kept, 0 dropped, 0 bad.